Jul 08 02:28:53 devstack cinder-volume[75992]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 02:28:53 devstack cinder-volume[75992]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 02:28:53 devstack cinder-volume[75992]: we strongly recommend against using it for new projects. Jul 08 02:28:53 devstack cinder-volume[75992]: If you are already using Eventlet, we recommend migrating to a different Jul 08 02:28:53 devstack cinder-volume[75992]: framework. For more detail see Jul 08 02:28:53 devstack cinder-volume[75992]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 02:28:53 devstack cinder-volume[75992]: import eventlet # noqa Jul 08 02:28:56 devstack cinder-volume[75992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75992) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 02:28:56 devstack cinder-volume[75992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75992) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 02:28:56 devstack cinder-volume[75992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75992) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 02:28:57 devstack cinder-volume[75992]: INFO dbcounter [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Registered counter for database cinder Jul 08 02:28:57 devstack cinder-volume[75992]: DEBUG oslo_db.sqlalchemy.engines [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75992) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 02:28:57 devstack cinder-volume[75992]: DEBUG dbcounter [-] [75992] Writer thread running {{(pid=75992) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 02:28:57 devstack cinder-volume[75992]: INFO cinder.rpc [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 02:28:57 devstack cinder-volume[75992]: INFO cinder.rpc [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 02:28:57 devstack cinder-volume[75992]: DEBUG oslo_db.sqlalchemy.engines [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75992) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 02:28:57 devstack cinder-volume[75992]: INFO cinder.volume.manager [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Determined volume DB was empty at startup. Jul 08 02:28:57 devstack cinder-volume[75992]: DEBUG cinder.volume.manager [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75992) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 02:28:57 devstack cinder-volume[75992]: INFO cinder.volume.manager [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 02:28:57 devstack cinder-volume[75992]: WARNING stevedore.named [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 02:28:57 devstack cinder-volume[75992]: WARNING castellan.key_manager [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 02:28:57 devstack cinder-volume[75992]: WARNING cinder.keymgr.conf_key_mgr [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 02:28:57 devstack cinder-volume[75992]: DEBUG cinder.volume.drivers.lvm [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75992) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 08 02:28:57 devstack cinder-volume[75992]: DEBUG oslo_concurrency.processutils [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75992) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_concurrency.processutils [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] CMD "cinder-rtstool verify" returned: 0 in 0.392s {{(pid=75992) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_db.sqlalchemy.engines [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75992) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 02:28:58 devstack cinder-volume[75992]: INFO cinder.rpc [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 08 02:28:58 devstack cinder-volume[75992]: INFO cinder.rpc [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 08 02:28:58 devstack cinder-volume[75992]: WARNING stevedore.named [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 02:28:58 devstack cinder-volume[75992]: WARNING castellan.key_manager [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 02:28:58 devstack cinder-volume[75992]: INFO cinder.volume.manager [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_db.sqlalchemy.engines [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75992) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 02:28:58 devstack cinder-volume[75992]: INFO oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Starting 1 workers Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Started child 76148 {{(pid=75992) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Full set of CONF: {{(pid=75992) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] ******************************************************************************** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Configuration options gathered from: {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] ================================================================================ {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] allow_availability_zone_fallback = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] allow_compression_on_image_upload = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] allowed_direct_url_schemes = [] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] api_rate_limit = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] auth_strategy = keystone {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] az_cache_duration = 3600 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_availability_zone = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[76148]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_host = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_name = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_stats_polling_interval = 60 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backup_api_class = cinder.backup.api.API {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backup_name_template = backup-%s {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backup_use_same_host = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backup_use_temp_snapshot = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] chap_password = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] chap_username = {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cinder_internal_tenant_project_id = 61b66e2e6267416eab714666819614b9 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cinder_internal_tenant_user_id = 0b554d939332496fb5008142e67a6323 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cloned_volume_same_az = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cluster = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] compression_format = gzip {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] compute_api_class = cinder.compute.nova.API {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] config_dir = [] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] config_source = [] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] control_exchange = openstack {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] debug = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] default_availability_zone = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] default_group_type = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] default_volume_type = lvmdriver-1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] disk_geometry = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] driver_client_cert = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] driver_client_cert_key = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] driver_data_namespace = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] driver_ssl_cert_path = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] driver_ssl_cert_verify = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] driver_use_ssl = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] enable_force_upload = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] enable_new_services = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] enable_unsupported_driver = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] enforce_multipath_for_image_xfer = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] filter_function = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance_api_insecure = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance_api_servers = ['http://192.168.122.249/image'] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance_api_ssl_compression = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance_ca_certificates_file = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance_catalog_info = image:glance:publicURL {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance_certfile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance_keyfile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance_num_retries = 3 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance_request_timeout = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] goodness_function = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] graceful_shutdown_timeout = 5 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] group_api_class = cinder.group.api.API {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] host = devstack {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] image_compress_on_upload = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] image_conversion_address_space_limit = 1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] image_conversion_cpu_limit = 60 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] image_conversion_disable = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] image_upload_use_cinder_backend = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] image_upload_use_internal_tenant = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] image_volume_cache_enabled = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] image_volume_cache_max_count = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] image_volume_cache_max_size_gb = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] init_host_max_objects_retrieval = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] instance_format = [instance: %(uuid)s] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] iscsi_target_flags = {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] iscsi_write_cache = on {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] iser_helper = tgtadm {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] iser_ip_address = 192.168.122.249 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] iser_port = 3260 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] log_color = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] log_config_append = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] log_dir = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] log_file = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] log_options = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] log_rotate_interval = 1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] log_rotate_interval_type = days {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] log_rotation_type = none {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] max_age = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] max_logfile_count = 30 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] max_logfile_size_mb = 200 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] max_over_subscription_ratio = 20.0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] message_reap_interval = 86400 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] message_ttl = 2592000 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] migration_create_volume_timeout_secs = 300 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] monkey_patch = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] monkey_patch_modules = [] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] my_ip = 192.168.122.249 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] no_snapshot_gb_quota = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] num_iser_scan_tries = 3 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] num_shell_tries = 3 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] num_volume_device_scan_tries = 3 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] nvmeof_conn_info_version = 1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] nvmet_ns_id = 10 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] nvmet_port_id = 1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] osapi_max_limit = 1000 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] osapi_volume_ext_list = [] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] osapi_volume_listen_port = 8776 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] osapi_volume_use_ssl = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] osapi_volume_workers = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] per_volume_size_limit = -1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] periodic_fuzzy_delay = 60 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] periodic_interval = 60 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] public_endpoint = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] publish_errors = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] quota_backup_gigabytes = 1000 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] quota_backups = 10 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] quota_gigabytes = 1000 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] quota_groups = 10 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] quota_snapshots = 10 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] quota_volumes = 10 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] rate_limit_burst = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] rate_limit_except_level = CRITICAL {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] rate_limit_interval = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] reinit_driver_count = 3 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] replication_device = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] report_discard_supported = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] report_interval = 120 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] reservation_clean_interval = 86400 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] reservation_expire = 86400 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] reserved_image_namespaces = [] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] reserved_percentage = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] rpc_response_timeout = 120 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] run_external_periodic_tasks = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] scst_target_driver = iscsi {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] scst_target_iqn_name = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] service_down_time = 720 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] shell_completion = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] snapshot_name_template = snapshot-%s {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] snapshot_same_host = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] split_loggers = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] state_path = /opt/stack/data/cinder {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] storage_availability_zone = nova {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] storage_protocol = iSCSI {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] syslog_log_facility = LOG_USER {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] target_helper = lioadm {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] target_ip_address = 192.168.122.249 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] target_port = 3260 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] target_protocol = iscsi {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] target_secondary_ip_addresses = [] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] trace_flags = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] transport_url = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] until_refresh = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] use_chap_auth = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] use_default_quota_class = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] use_journal = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] use_json = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] use_multipath_for_image_xfer = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] use_stderr = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] use_syslog = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] verify_glance_signatures = enabled {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] volume_api_class = cinder.volume.api.API {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] volume_backend_name = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] volume_clear = zero {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] volume_clear_ionice = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] volume_clear_size = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] volume_copy_bps_limit = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] volume_dd_blocksize = 1M {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] volume_name_template = volume-%s {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] volume_service_inithost_offload = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] volume_usage_audit_period = month {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[76148]: INFO cinder.volume.manager [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] zoning_mode = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_concurrency.disable_process_locking = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.auth_section = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.auth_type = password {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.auth_version = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.cache = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.certfile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.include_service_catalog = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.insecure = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.interface = public {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.keyfile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcache_password = {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcache_username = {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.region_name = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.service_type = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.249/identity {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.backend = dogpile.cache.null {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.backend_argument = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.backend_expiration_time = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.config_prefix = cache.oslo {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.debug_cache_backend = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.enable_retry_client = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.enable_socket_keepalive = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.enabled = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.expiration_time = 600 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.hashclient_retry_attempts = 2 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.memcache_dead_retry = 300 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.memcache_pool_maxsize = 10 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.memcache_sasl_enabled = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.password = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.proxies = [] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.redis_db = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.redis_server = localhost:6379 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.retry_attempts = 2 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.retry_delay = 0.0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.socket_keepalive_count = 1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.socket_keepalive_idle = 1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.socket_keepalive_interval = 1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.socket_timeout = 1.0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.tls_allowed_ciphers = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.tls_cafile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.tls_certfile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.tls_enabled = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.tls_keyfile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cache.username = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] coordination.backend_url = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.asyncio_connection = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.asyncio_slave_connection = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.backend = sqlalchemy {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.connection = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.connection_debug = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.connection_parameters = {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.connection_recycle_time = 3600 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.connection_trace = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.db_inc_retry_interval = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.db_max_retries = 20 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.db_max_retry_interval = 10 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.db_retry_interval = 1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.max_overflow = 50 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.max_pool_size = 5 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.max_retries = 10 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.mysql_wsrep_sync_wait = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.pool_timeout = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.retry_interval = 10 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.slave_connection = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.sqlite_synchronous = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.synchronous_reader = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] database.use_db_reconnect = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] profiler.connection_string = messaging:// {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] profiler.enabled = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] profiler.es_doc_type = notification {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] profiler.es_scroll_size = 10000 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] profiler.es_scroll_time = 2m {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] profiler.filter_error_trace = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] profiler.hmac_keys = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] profiler.sentinel_service_name = mymaster {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] profiler.socket_timeout = 0.1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] profiler.trace_requests = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] profiler.trace_sqlalchemy = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] profiler_jaeger.process_tags = {} {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] profiler_jaeger.service_name_prefix = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] profiler_otlp.service_name_prefix = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_policy.enforce_new_defaults = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_policy.enforce_scope = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_policy.policy_default_rule = default {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_policy.policy_file = policy.yaml {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] privsep_osbrick.group = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] privsep_osbrick.helper_command = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] privsep_osbrick.user = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cinder_sys_admin.group = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cinder_sys_admin.helper_command = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] cinder_sys_admin.user = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] service_user.auth_section = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] service_user.auth_type = password {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] service_user.cafile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] service_user.certfile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] service_user.collect_timing = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] service_user.insecure = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] service_user.keyfile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] service_user.send_service_user_token = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] service_user.split_loggers = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] service_user.timeout = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance.auth_section = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance.auth_type = password {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance.certfile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance.collect_timing = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance.insecure = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance.keyfile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance.region_name = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance.split_loggers = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] glance.timeout = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.backend_availability_zone = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.chap_password = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.chap_username = {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.disk_geometry = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.driver_client_cert = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.driver_client_cert_key = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.driver_data_namespace = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.driver_use_ssl = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.extra_capabilities = {} {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.filter_function = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.goodness_function = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.iscsi_target_flags = {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.iscsi_write_cache = on {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.iser_helper = tgtadm {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.iser_ip_address = 192.168.122.249 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.iser_port = 3260 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.lvm_share_target = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.lvm_type = auto {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.num_shell_tries = 3 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.replication_device = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.report_discard_supported = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.reserved_percentage = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.target_helper = tgtadm {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.target_ip_address = 192.168.122.249 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.target_port = 3260 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.target_protocol = iscsi {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.trace_flags = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.unique_fqdn_network = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.use_chap_auth = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.volume_backend_name = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.volume_clear = zero {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.volume_clear_ionice = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.volume_clear_size = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_reports.file_event_handler = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_reports.log_dir = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.backend_host = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.chap_password = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.chap_username = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.disk_geometry = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.driver_client_cert = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.extra_capabilities = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.filter_function = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.goodness_function = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.iser_helper = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.iser_ip_address = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.iser_port = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.lvm_share_target = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.lvm_type = auto {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.num_shell_tries = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.replication_device = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.report_discard_supported = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.reserved_percentage = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.scst_target_driver = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.storage_protocol = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.target_helper = lioadm {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.target_ip_address = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.target_port = 3260 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.trace_flags = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.use_chap_auth = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.volume_clear = zero {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.volume_clear_size = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] lvmdriver-1.volumes_dir = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.ssl = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_notifications.driver = [] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_notifications.retry = -1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] key_manager.fixed_key = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.barbican_api_version = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.barbican_endpoint = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.barbican_endpoint_type = public {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.barbican_region_name = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.cafile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.certfile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.collect_timing = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.insecure = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.keyfile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.number_of_retries = 60 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.retry_delay = 1 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.send_service_user_token = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.split_loggers = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack sudo[76152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.timeout = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.verify_ssl = True {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican.verify_ssl_path = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican_service_user.auth_section = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican_service_user.auth_type = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican_service_user.cafile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican_service_user.certfile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican_service_user.collect_timing = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack sudo[76152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican_service_user.insecure = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican_service_user.keyfile = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican_service_user.split_loggers = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] barbican_service_user.timeout = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] vault.approle_role_id = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] vault.approle_secret_id = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] vault.kv_mountpoint = secret {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] vault.kv_path = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] vault.kv_version = 2 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] vault.namespace = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] vault.root_token_id = **** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] vault.ssl_ca_crt_file = None {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] vault.timeout = 60.0 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] vault.use_ssl = False {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:28:58 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] ******************************************************************************** {{(pid=75992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 02:28:59 devstack sudo[76152]: pam_unix(sudo:session): session closed for user root Jul 08 02:28:59 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.726s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:28:59 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:28:59 devstack sudo[76196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 02:28:59 devstack sudo[76196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:00 devstack sudo[76196]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:00 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.744s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:00 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:29:00 devstack cinder-volume[76148]: INFO cinder.brick.local_dev.lvm [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 08 02:29:00 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:00 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:00 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:00 devstack sudo[76520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 02:29:00 devstack sudo[76520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:00 devstack sudo[76520]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:00 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.738s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:00 devstack cinder-volume[76148]: DEBUG cinder.brick.local_dev.lvm [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76148) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 08 02:29:00 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:00 devstack sudo[76716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 02:29:00 devstack sudo[76716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:02 devstack sudo[76716]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:02 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.198s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:02 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:02 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:02 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:02 devstack sudo[76928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 02:29:02 devstack sudo[76928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:02 devstack sudo[76928]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:02 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.702s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:02 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:02 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:02 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:02 devstack sudo[76933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 08 02:29:02 devstack sudo[76933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:03 devstack sudo[76933]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:03 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.864s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:03 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:03 devstack sudo[76936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 02:29:03 devstack sudo[76936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:04 devstack sudo[76936]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:04 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.798s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:04 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:04 devstack sudo[76942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 02:29:04 devstack sudo[76942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:05 devstack sudo[76942]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:05 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.868s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:05 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:05 devstack sudo[76953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 02:29:05 devstack sudo[76953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:06 devstack sudo[76953]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:06 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.792s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:06 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:06 devstack sudo[76963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 02:29:06 devstack sudo[76963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:06 devstack sudo[76963]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:06 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.656s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:06 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:06 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:06 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:06 devstack sudo[76967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 02:29:06 devstack sudo[76967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:07 devstack sudo[76967]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:07 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.779s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:07 devstack cinder-volume[76148]: INFO cinder.volume.drivers.lvm [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 08 02:29:07 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:07 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:07 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:07 devstack sudo[77010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 02:29:07 devstack sudo[77010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:08 devstack sudo[77010]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:08 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.771s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:08 devstack cinder-volume[76148]: DEBUG cinder.volume.drivers.lvm [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Updating volume stats {{(pid=76148) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 02:29:08 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:08 devstack sudo[77107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 02:29:08 devstack sudo[77107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:08 devstack cinder-volume[75992]: DEBUG dbcounter [-] [75992] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75992) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:29:09 devstack sudo[77107]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:09 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:09 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:09 devstack sudo[77235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 02:29:09 devstack sudo[77235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:09 devstack sudo[77235]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:09 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:09 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:09 devstack sudo[77238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 02:29:09 devstack sudo[77238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:10 devstack sudo[77238]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:10 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.620s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:10 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:10 devstack sudo[77241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 02:29:10 devstack sudo[77241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:11 devstack sudo[77241]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:11 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:11 devstack cinder-volume[76148]: INFO cinder.volume.driver [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Driver hasn't implemented _init_vendor_properties() Jul 08 02:29:11 devstack cinder-volume[76148]: DEBUG cinder.volume.driver [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76148) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 02:29:11 devstack cinder-volume[76148]: DEBUG oslo_db.sqlalchemy.engines [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76148) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 02:29:11 devstack cinder-volume[76148]: DEBUG dbcounter [-] [76148] Writer thread running {{(pid=76148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 02:29:11 devstack cinder-volume[76148]: DEBUG cinder.db.api [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Building query based on filter {{(pid=76148) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 02:29:11 devstack cinder-volume[76148]: DEBUG cinder.image.image_utils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76148) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 02:29:11 devstack cinder-volume[76148]: INFO cinder.keymgr.migration [None req-070efcd1-02ba-421e-a77f-dabeca8869f5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 02:29:11 devstack cinder-volume[76148]: DEBUG cinder.volume.drivers.lvm [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Updating volume stats {{(pid=76148) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 02:29:11 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:11 devstack sudo[77246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 02:29:11 devstack sudo[77246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:11 devstack sudo[77246]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:11 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:11 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:11 devstack sudo[77249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 02:29:11 devstack sudo[77249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:12 devstack sudo[77249]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:12 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.700s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:12 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:12 devstack sudo[77291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 02:29:12 devstack sudo[77291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:13 devstack sudo[77291]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:13 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.674s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:13 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:13 devstack sudo[77295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 02:29:13 devstack sudo[77295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:13 devstack sudo[77295]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:13 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:13 devstack cinder-volume[76148]: DEBUG cinder.manager [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Notifying Schedulers of capabilities ... {{(pid=76148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:29:13 devstack cinder-volume[76148]: INFO cinder.volume.manager [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Driver initialization completed successfully. Jul 08 02:29:13 devstack cinder-volume[76148]: INFO cinder.manager [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Initiating service 2 cleanup Jul 08 02:29:13 devstack cinder-volume[76148]: INFO cinder.manager [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Service 2 cleanup completed. Jul 08 02:29:13 devstack cinder-volume[76148]: DEBUG cinder.service [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Creating RPC server for service cinder-volume {{(pid=76148) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 02:29:13 devstack cinder-volume[76148]: DEBUG cinder.service [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76148) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 02:29:14 devstack cinder-volume[76148]: INFO cinder.volume.manager [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 08 02:29:14 devstack cinder-volume[76148]: DEBUG cinder.volume.drivers.lvm [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Updating volume stats {{(pid=76148) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 02:29:14 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:14 devstack sudo[77300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 02:29:14 devstack sudo[77300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:14 devstack sudo[77300]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:14 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:14 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:14 devstack sudo[77303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 02:29:14 devstack sudo[77303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:15 devstack sudo[77303]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:15 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:15 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:15 devstack sudo[77310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 02:29:15 devstack sudo[77310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:16 devstack sudo[77310]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:16 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.655s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:16 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:29:16 devstack sudo[77366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 02:29:16 devstack sudo[77366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:29:16 devstack sudo[77366]: pam_unix(sudo:session): session closed for user root Jul 08 02:29:16 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:29:16 devstack cinder-volume[76148]: INFO cinder.volume.manager [None req-b582f29e-f003-4f74-869a-2a6678895a6d None None] Driver post RPC initialization completed successfully. Jul 08 02:29:26 devstack cinder-volume[76148]: DEBUG dbcounter [-] [76148] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:29:26 devstack cinder-volume[76148]: DEBUG dbcounter [-] [76148] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:29:26 devstack cinder-volume[76148]: DEBUG oslo_service.periodic_task [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running periodic task VolumeManager._thread_info {{(pid=76148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:29:26 devstack cinder-volume[76148]: DEBUG cinder.volume.manager [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] thread count: 6 {{(pid=76148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:29:26 devstack cinder-volume[76148]: DEBUG cinder.volume.manager [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] thread info: [<_MainThread(MainThread, started 137819649044608)>, , , , , ] {{(pid=76148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:30:26 devstack cinder-volume[76148]: DEBUG oslo_service.periodic_task [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:30:26 devstack cinder-volume[76148]: DEBUG cinder.volume.drivers.lvm [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Updating volume stats {{(pid=76148) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 02:30:26 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:30:26 devstack sudo[79403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 02:30:26 devstack sudo[79403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:30:27 devstack sudo[79403]: pam_unix(sudo:session): session closed for user root Jul 08 02:30:27 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:30:27 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:30:27 devstack sudo[79422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 02:30:27 devstack sudo[79422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:30:28 devstack sudo[79422]: pam_unix(sudo:session): session closed for user root Jul 08 02:30:28 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:30:28 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:30:28 devstack sudo[79427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 02:30:28 devstack sudo[79427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:30:28 devstack sudo[79427]: pam_unix(sudo:session): session closed for user root Jul 08 02:30:28 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:30:28 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:30:28 devstack sudo[79466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 02:30:28 devstack sudo[79466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:30:29 devstack sudo[79466]: pam_unix(sudo:session): session closed for user root Jul 08 02:30:29 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:30:29 devstack cinder-volume[76148]: DEBUG cinder.manager [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Notifying Schedulers of capabilities ... {{(pid=76148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:30:29 devstack cinder-volume[76148]: DEBUG oslo_service.periodic_task [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running periodic task VolumeManager._thread_info {{(pid=76148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:30:29 devstack cinder-volume[76148]: DEBUG cinder.volume.manager [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] thread count: 6 {{(pid=76148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:30:29 devstack cinder-volume[76148]: DEBUG cinder.volume.manager [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] thread info: [<_MainThread(MainThread, started 137819649044608)>, , , , , ] {{(pid=76148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:31:26 devstack cinder-volume[76148]: DEBUG dbcounter [-] [76148] Writing DB stats cinder:SELECT=1 {{(pid=76148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:31:26 devstack cinder-volume[76148]: DEBUG dbcounter [-] [76148] Writing DB stats cinder:UPDATE=1 {{(pid=76148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:31:26 devstack cinder-volume[76148]: DEBUG oslo_service.periodic_task [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:31:26 devstack cinder-volume[76148]: DEBUG cinder.volume.drivers.lvm [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Updating volume stats {{(pid=76148) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 02:31:26 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:31:26 devstack sudo[82626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 02:31:26 devstack sudo[82626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:31:27 devstack sudo[82626]: pam_unix(sudo:session): session closed for user root Jul 08 02:31:27 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:31:27 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:31:27 devstack sudo[82631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 02:31:27 devstack sudo[82631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:31:27 devstack sudo[82631]: pam_unix(sudo:session): session closed for user root Jul 08 02:31:27 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.608s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:31:28 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:31:28 devstack sudo[82638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 02:31:28 devstack sudo[82638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:31:28 devstack sudo[82638]: pam_unix(sudo:session): session closed for user root Jul 08 02:31:28 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:31:28 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:31:28 devstack sudo[82653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 02:31:28 devstack sudo[82653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:31:29 devstack sudo[82653]: pam_unix(sudo:session): session closed for user root Jul 08 02:31:29 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:31:29 devstack cinder-volume[76148]: DEBUG cinder.manager [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Notifying Schedulers of capabilities ... {{(pid=76148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:31:29 devstack cinder-volume[76148]: DEBUG oslo_service.periodic_task [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running periodic task VolumeManager._thread_info {{(pid=76148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:31:29 devstack cinder-volume[76148]: DEBUG cinder.volume.manager [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] thread count: 6 {{(pid=76148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:31:29 devstack cinder-volume[76148]: DEBUG cinder.volume.manager [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] thread info: [<_MainThread(MainThread, started 137819649044608)>, , , , , ] {{(pid=76148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:32:26 devstack cinder-volume[76148]: DEBUG oslo_service.periodic_task [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:32:26 devstack cinder-volume[76148]: DEBUG cinder.volume.drivers.lvm [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Updating volume stats {{(pid=76148) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 02:32:26 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:32:26 devstack sudo[84743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 02:32:26 devstack sudo[84743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:32:27 devstack sudo[84743]: pam_unix(sudo:session): session closed for user root Jul 08 02:32:27 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:32:27 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:32:27 devstack sudo[84806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 02:32:27 devstack sudo[84806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:32:28 devstack sudo[84806]: pam_unix(sudo:session): session closed for user root Jul 08 02:32:28 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:32:28 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:32:28 devstack sudo[84826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 02:32:28 devstack sudo[84826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:32:28 devstack sudo[84826]: pam_unix(sudo:session): session closed for user root Jul 08 02:32:28 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.635s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:32:28 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:32:28 devstack sudo[84860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 02:32:28 devstack sudo[84860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:32:29 devstack sudo[84860]: pam_unix(sudo:session): session closed for user root Jul 08 02:32:29 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:32:29 devstack cinder-volume[76148]: DEBUG cinder.manager [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Notifying Schedulers of capabilities ... {{(pid=76148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:32:29 devstack cinder-volume[76148]: DEBUG oslo_service.periodic_task [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running periodic task VolumeManager._thread_info {{(pid=76148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:32:29 devstack cinder-volume[76148]: DEBUG cinder.volume.manager [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] thread count: 6 {{(pid=76148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:32:29 devstack cinder-volume[76148]: DEBUG cinder.volume.manager [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] thread info: [<_MainThread(MainThread, started 137819649044608)>, , , , , ] {{(pid=76148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:33:26 devstack cinder-volume[76148]: DEBUG dbcounter [-] [76148] Writing DB stats cinder:SELECT=1 {{(pid=76148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:33:26 devstack cinder-volume[76148]: DEBUG dbcounter [-] [76148] Writing DB stats cinder:UPDATE=1 {{(pid=76148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:33:26 devstack cinder-volume[76148]: DEBUG oslo_service.periodic_task [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:33:26 devstack cinder-volume[76148]: DEBUG cinder.volume.drivers.lvm [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Updating volume stats {{(pid=76148) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 02:33:26 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:33:26 devstack sudo[85918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 02:33:26 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:33:27 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root Jul 08 02:33:27 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:33:27 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:33:27 devstack sudo[85922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 02:33:27 devstack sudo[85922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:33:28 devstack sudo[85922]: pam_unix(sudo:session): session closed for user root Jul 08 02:33:28 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:33:28 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:33:28 devstack sudo[85936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 02:33:28 devstack sudo[85936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:33:28 devstack sudo[85936]: pam_unix(sudo:session): session closed for user root Jul 08 02:33:28 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.606s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:33:28 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:33:28 devstack sudo[85945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 02:33:28 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:33:29 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root Jul 08 02:33:29 devstack cinder-volume[76148]: DEBUG oslo_concurrency.processutils [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.608s {{(pid=76148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:33:29 devstack cinder-volume[76148]: DEBUG cinder.manager [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Notifying Schedulers of capabilities ... {{(pid=76148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:33:29 devstack cinder-volume[76148]: DEBUG oslo_service.periodic_task [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] Running periodic task VolumeManager._thread_info {{(pid=76148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:33:29 devstack cinder-volume[76148]: DEBUG cinder.volume.manager [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] thread count: 6 {{(pid=76148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:33:29 devstack cinder-volume[76148]: DEBUG cinder.volume.manager [None req-bdcc2fd4-cc49-4ff4-ac71-c73e9ffb64a4 None None] thread info: [<_MainThread(MainThread, started 137819649044608)>, , , , , ] {{(pid=76148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:33:36 devstack cinder-volume[75992]: INFO oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Caught SIGTERM, stopping children Jul 08 02:33:36 devstack cinder-volume[75992]: DEBUG oslo_concurrency.lockutils [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Acquiring lock "singleton_lock" {{(pid=75992) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 02:33:36 devstack cinder-volume[75992]: DEBUG oslo_concurrency.lockutils [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Acquired lock "singleton_lock" {{(pid=75992) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 02:33:36 devstack cinder-volume[75992]: DEBUG oslo_concurrency.lockutils [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Releasing lock "singleton_lock" {{(pid=75992) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 02:33:36 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Stop services. {{(pid=75992) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 02:33:36 devstack cinder-volume[75992]: DEBUG oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Killing children. {{(pid=75992) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 02:33:36 devstack cinder-volume[75992]: INFO oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Waiting on 1 children to exit Jul 08 02:33:39 devstack cinder-volume[76148]: DEBUG oslo_concurrency.lockutils [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Acquiring lock "singleton_lock" {{(pid=76148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 02:33:39 devstack cinder-volume[76148]: DEBUG oslo_concurrency.lockutils [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Acquired lock "singleton_lock" {{(pid=76148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 02:33:39 devstack cinder-volume[76148]: DEBUG oslo_concurrency.lockutils [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Releasing lock "singleton_lock" {{(pid=76148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 02:33:39 devstack cinder-volume[76148]: WARNING amqp [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 02:33:39 devstack cinder-volume[76148]: WARNING amqp [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 02:33:39 devstack cinder-volume[75992]: INFO oslo_service.backend._eventlet.service [None req-f2ca8727-2b05-4973-9d69-373d34968734 None None] Child 76148 exited with status 0 Jul 08 02:33:39 devstack cinder-volume[86289]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 02:33:39 devstack cinder-volume[86289]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 02:33:39 devstack cinder-volume[86289]: we strongly recommend against using it for new projects. Jul 08 02:33:39 devstack cinder-volume[86289]: If you are already using Eventlet, we recommend migrating to a different Jul 08 02:33:39 devstack cinder-volume[86289]: framework. For more detail see Jul 08 02:33:39 devstack cinder-volume[86289]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 02:33:39 devstack cinder-volume[86289]: import eventlet # noqa Jul 08 02:33:41 devstack cinder-volume[86289]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 02:33:41 devstack cinder-volume[86289]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 02:33:41 devstack cinder-volume[86289]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 02:33:42 devstack cinder-volume[86289]: INFO dbcounter [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Registered counter for database cinder Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_db.sqlalchemy.engines [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG dbcounter [-] [86289] Writer thread running {{(pid=86289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 02:33:42 devstack cinder-volume[86289]: INFO cinder.rpc [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 02:33:42 devstack cinder-volume[86289]: INFO cinder.rpc [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_db.sqlalchemy.engines [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 02:33:42 devstack cinder-volume[86289]: INFO cinder.volume.manager [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Determined volume DB was empty at startup. Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG cinder.volume.manager [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86289) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 02:33:42 devstack cinder-volume[86289]: INFO cinder.volume.manager [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 02:33:42 devstack cinder-volume[86289]: WARNING stevedore.named [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 02:33:42 devstack cinder-volume[86289]: WARNING castellan.key_manager [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 02:33:42 devstack cinder-volume[86289]: WARNING cinder.keymgr.conf_key_mgr [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 02:33:42 devstack cinder-volume[86289]: INFO cinder.volume.manager [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_db.sqlalchemy.engines [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 02:33:42 devstack cinder-volume[86289]: INFO oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Starting 1 workers Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Started child 86505 {{(pid=86289) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 02:33:42 devstack cinder-volume[86505]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Full set of CONF: {{(pid=86289) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] ******************************************************************************** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Configuration options gathered from: {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] ================================================================================ {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] allow_availability_zone_fallback = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] allow_compression_on_image_upload = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] allowed_direct_url_schemes = [] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] api_rate_limit = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] auth_strategy = keystone {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_availability_zone = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_host = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_name = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_stats_polling_interval = 60 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backup_api_class = cinder.backup.api.API {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backup_name_template = backup-%s {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backup_use_same_host = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backup_use_temp_snapshot = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] chap_password = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] chap_username = {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cinder_internal_tenant_project_id = 61b66e2e6267416eab714666819614b9 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cinder_internal_tenant_user_id = 0b554d939332496fb5008142e67a6323 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cluster = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] compression_format = gzip {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] compute_api_class = cinder.compute.nova.API {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] config_dir = [] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] config_source = [] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] control_exchange = openstack {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] debug = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] default_availability_zone = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] default_group_type = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] default_volume_type = QuobyteHD {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] disk_geometry = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] driver_client_cert = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] driver_client_cert_key = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] driver_data_namespace = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] driver_ssl_cert_path = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] driver_ssl_cert_verify = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] driver_use_ssl = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] enable_new_services = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] enable_unsupported_driver = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] enabled_backends = ['QuobyteHD'] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] enforce_multipath_for_image_xfer = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] filter_function = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance_api_insecure = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance_api_servers = ['http://192.168.122.249/image'] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance_api_ssl_compression = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance_ca_certificates_file = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance_catalog_info = image:glance:publicURL {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance_certfile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance_keyfile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance_num_retries = 3 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance_request_timeout = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] goodness_function = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] graceful_shutdown_timeout = 5 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] group_api_class = cinder.group.api.API {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] host = devstack {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] image_compress_on_upload = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] image_conversion_address_space_limit = 1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] image_conversion_cpu_limit = 60 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] image_conversion_disable = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] image_upload_use_cinder_backend = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] image_upload_use_internal_tenant = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] image_volume_cache_enabled = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] image_volume_cache_max_count = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] image_volume_cache_max_size_gb = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] init_host_max_objects_retrieval = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] instance_format = [instance: %(uuid)s] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] iscsi_target_flags = {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] iscsi_write_cache = on {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] iser_helper = tgtadm {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] iser_ip_address = 192.168.122.249 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] iser_port = 3260 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] log_color = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] log_config_append = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] log_dir = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] log_file = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] log_options = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] log_rotate_interval = 1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] log_rotate_interval_type = days {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] log_rotation_type = none {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] max_age = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] max_logfile_count = 30 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] max_logfile_size_mb = 200 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] max_over_subscription_ratio = 20.0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] message_reap_interval = 86400 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] message_ttl = 2592000 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] migration_create_volume_timeout_secs = 300 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] monkey_patch = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] monkey_patch_modules = [] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86505]: INFO cinder.volume.manager [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] my_ip = 192.168.122.249 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] no_snapshot_gb_quota = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] num_iser_scan_tries = 3 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] num_shell_tries = 3 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] num_volume_device_scan_tries = 3 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] nvmeof_conn_info_version = 1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] nvmet_ns_id = 10 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] nvmet_port_id = 1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] osapi_max_limit = 1000 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] osapi_volume_ext_list = [] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] osapi_volume_listen_port = 8776 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] osapi_volume_use_ssl = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] osapi_volume_workers = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] per_volume_size_limit = -1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] periodic_fuzzy_delay = 60 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] periodic_interval = 60 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] public_endpoint = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] publish_errors = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] quota_backup_gigabytes = 1000 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] quota_backups = 10 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] quota_gigabytes = 1000 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] quota_groups = 10 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] quota_snapshots = 10 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] quota_volumes = 10 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] rate_limit_burst = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] rate_limit_except_level = CRITICAL {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] rate_limit_interval = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] reinit_driver_count = 3 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] replication_device = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] report_discard_supported = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] report_interval = 120 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] reservation_clean_interval = 86400 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] reservation_expire = 86400 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] reserved_image_namespaces = [] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.remotefs [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86505) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] reserved_percentage = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] rpc_response_timeout = 120 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] run_external_periodic_tasks = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] scst_target_driver = iscsi {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] scst_target_iqn_name = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] service_down_time = 720 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] shell_completion = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] snapshot_name_template = snapshot-%s {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] split_loggers = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] state_path = /opt/stack/data/cinder {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] storage_availability_zone = nova {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] storage_protocol = iSCSI {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] syslog_log_facility = LOG_USER {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] target_helper = lioadm {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] target_ip_address = 192.168.122.249 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:42 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] target_port = 3260 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] target_protocol = iscsi {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] target_secondary_ip_addresses = [] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] trace_flags = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] transport_url = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] until_refresh = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] use_chap_auth = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] use_default_quota_class = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] use_journal = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] use_json = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] use_multipath_for_image_xfer = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] use_stderr = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] use_syslog = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] verify_glance_signatures = enabled {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] volume_api_class = cinder.volume.api.API {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] volume_backend_name = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] volume_clear = zero {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] volume_clear_ionice = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] volume_clear_size = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] volume_copy_bps_limit = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] volume_dd_blocksize = 1M {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] volume_name_template = volume-%s {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] volume_service_inithost_offload = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] volume_usage_audit_period = month {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] zoning_mode = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_concurrency.disable_process_locking = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.auth_section = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.auth_type = password {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.auth_version = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.cache = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.certfile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.include_service_catalog = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.insecure = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.interface = public {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.keyfile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcache_password = {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcache_username = {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.region_name = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.service_type = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.249/identity {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.backend = dogpile.cache.null {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.backend_argument = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.backend_expiration_time = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.config_prefix = cache.oslo {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.debug_cache_backend = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.enable_retry_client = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.enable_socket_keepalive = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.enabled = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.expiration_time = 600 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.hashclient_retry_attempts = 2 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.memcache_dead_retry = 300 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.memcache_pool_maxsize = 10 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.memcache_sasl_enabled = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.password = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.proxies = [] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.redis_db = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.redis_server = localhost:6379 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.retry_attempts = 2 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.retry_delay = 0.0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.socket_keepalive_count = 1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.socket_keepalive_idle = 1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.socket_keepalive_interval = 1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.socket_timeout = 1.0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.tls_allowed_ciphers = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.tls_cafile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.tls_certfile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.tls_enabled = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.tls_keyfile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cache.username = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] coordination.backend_url = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.asyncio_connection = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.asyncio_slave_connection = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.backend = sqlalchemy {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.connection = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.connection_debug = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.connection_parameters = {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.connection_recycle_time = 3600 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.connection_trace = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.db_inc_retry_interval = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.db_max_retries = 20 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.db_max_retry_interval = 10 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.db_retry_interval = 1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.max_overflow = 50 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.max_pool_size = 5 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.max_retries = 10 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.mysql_wsrep_sync_wait = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.pool_timeout = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.retry_interval = 10 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.slave_connection = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.sqlite_synchronous = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.synchronous_reader = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] database.use_db_reconnect = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] profiler.connection_string = messaging:// {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] profiler.enabled = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] profiler.es_doc_type = notification {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] profiler.es_scroll_size = 10000 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] profiler.es_scroll_time = 2m {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] profiler.filter_error_trace = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] profiler.hmac_keys = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] profiler.sentinel_service_name = mymaster {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] profiler.socket_timeout = 0.1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] profiler.trace_requests = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] profiler.trace_sqlalchemy = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] profiler_jaeger.process_tags = {} {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] profiler_jaeger.service_name_prefix = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] profiler_otlp.service_name_prefix = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_policy.enforce_new_defaults = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_policy.enforce_scope = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_policy.policy_default_rule = default {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_policy.policy_file = policy.yaml {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] privsep_osbrick.group = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] privsep_osbrick.helper_command = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] privsep_osbrick.user = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cinder_sys_admin.group = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cinder_sys_admin.helper_command = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] cinder_sys_admin.user = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] service_user.auth_section = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] service_user.auth_type = password {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] service_user.cafile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] service_user.certfile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] service_user.collect_timing = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] service_user.insecure = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] service_user.keyfile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] service_user.send_service_user_token = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] service_user.split_loggers = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] service_user.timeout = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance.auth_section = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance.auth_type = password {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance.certfile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance.collect_timing = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance.insecure = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance.keyfile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance.region_name = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance.split_loggers = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] glance.timeout = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.backend_availability_zone = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.chap_password = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.chap_username = {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.disk_geometry = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.driver_client_cert = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.driver_client_cert_key = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.driver_data_namespace = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86505) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86505]: WARNING cinder.volume.drivers.quobyte [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 02:33:43 devstack cinder-volume[86505]: WARNING cinder.volume.drivers.quobyte [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 02:33:43 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Running cmd (subprocess): mount.quobyte {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.driver_use_ssl = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.extra_capabilities = {} {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.filter_function = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.goodness_function = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.iscsi_target_flags = {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.iscsi_write_cache = on {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.iser_helper = tgtadm {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.iser_ip_address = 192.168.122.249 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.iser_port = 3260 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.nas_host = {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.nas_login = admin {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.nas_mount_options = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.nas_password = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.nas_private_key = {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.nas_share_path = {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.num_shell_tries = 3 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.quobyte_volume_url = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.replication_device = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.report_discard_supported = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.reserved_percentage = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.target_helper = tgtadm {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.target_ip_address = 192.168.122.249 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.target_port = 3260 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.target_protocol = iscsi {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.trace_flags = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.unique_fqdn_network = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.use_chap_auth = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.volume_backend_name = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.volume_clear = zero {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.volume_clear_ionice = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.volume_clear_size = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_reports.file_event_handler = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_reports.log_dir = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.backend_availability_zone = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.backend_host = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.chap_password = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.chap_username = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.chiscsi_conf = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.disk_geometry = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.driver_client_cert = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.driver_data_namespace = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.driver_use_ssl = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.extra_capabilities = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.filter_function = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.goodness_function = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.iser_helper = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.iser_ip_address = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.iser_port = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.iser_target_prefix = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.nas_host = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.nas_login = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.nas_mount_options = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.nas_password = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.nas_private_key = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.nas_share_path = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.nas_ssh_port = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.num_shell_tries = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.nvmet_port_id = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.replication_device = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.report_discard_supported = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.reserved_percentage = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.scst_target_driver = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.storage_protocol = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.target_helper = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.target_ip_address = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.target_port = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.target_prefix = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.target_protocol = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.trace_flags = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.use_chap_auth = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.volume_clear = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.volume_clear_size = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] QuobyteHD.volumes_dir = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.ssl = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] CMD "mount.quobyte" returned: 1 in 0.134s {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:33:43 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_notifications.driver = [] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_notifications.retry = -1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:33:43 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=86505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] key_manager.fixed_key = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86505]: INFO cinder.volume.drivers.quobyte [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 ... Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.barbican_api_version = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.barbican_endpoint = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.barbican_endpoint_type = public {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b -c /etc/quobyte/client-cinder.cfg {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.barbican_region_name = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.cafile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.certfile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.collect_timing = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.insecure = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.keyfile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.number_of_retries = 60 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.retry_delay = 1 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.send_service_user_token = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.split_loggers = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.timeout = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.verify_ssl = True {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican.verify_ssl_path = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican_service_user.auth_section = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican_service_user.auth_type = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican_service_user.cafile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican_service_user.certfile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican_service_user.collect_timing = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican_service_user.insecure = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican_service_user.keyfile = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican_service_user.split_loggers = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] barbican_service_user.timeout = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] vault.approle_role_id = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] vault.approle_secret_id = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] vault.kv_mountpoint = secret {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] vault.kv_path = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] vault.kv_version = 2 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] vault.namespace = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] vault.root_token_id = **** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] vault.ssl_ca_crt_file = None {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] vault.timeout = 60.0 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] vault.use_ssl = False {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:43 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] ******************************************************************************** {{(pid=86289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 02:33:43 devstack sudo[86507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b -c /etc/quobyte/client-cinder.cfg Jul 08 02:33:43 devstack sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:33:44 devstack sudo[86507]: pam_unix(sudo:session): session closed for user root Jul 08 02:33:44 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.776s {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:33:44 devstack cinder-volume[86505]: INFO cinder.volume.drivers.quobyte [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 succeeded Jul 08 02:33:44 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=86505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:33:44 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.796s {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:33:44 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:33:44 devstack sudo[86584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:33:44 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:33:44 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root Jul 08 02:33:44 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.685s {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:33:44 devstack cinder-volume[86505]: INFO cinder.volume.driver [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Driver hasn't implemented _init_vendor_properties() Jul 08 02:33:44 devstack cinder-volume[86505]: DEBUG cinder.volume.driver [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7092323303223, 'free_capacity_gb': 1775.7092323303223, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86505) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 02:33:44 devstack cinder-volume[86505]: DEBUG oslo_db.sqlalchemy.engines [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86505) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 02:33:44 devstack cinder-volume[86505]: DEBUG dbcounter [-] [86505] Writer thread running {{(pid=86505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 02:33:44 devstack cinder-volume[86505]: DEBUG cinder.db.api [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Building query based on filter {{(pid=86505) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 02:33:44 devstack cinder-volume[86505]: DEBUG cinder.image.image_utils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86505) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 02:33:44 devstack cinder-volume[86505]: INFO cinder.keymgr.migration [None req-51ab415c-42bf-4e32-89d8-e3d887ae04b0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 02:33:44 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:33:44 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:33:44 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=86505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:33:44 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=86505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:33:44 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:33:44 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:33:44 devstack sudo[86607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:33:44 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:33:45 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root Jul 08 02:33:45 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.664s {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:33:45 devstack cinder-volume[86505]: DEBUG cinder.manager [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Notifying Schedulers of capabilities ... {{(pid=86505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:33:45 devstack cinder-volume[86505]: INFO cinder.volume.manager [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Driver initialization completed successfully. Jul 08 02:33:45 devstack cinder-volume[86505]: INFO cinder.manager [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Initiating service 3 cleanup Jul 08 02:33:45 devstack cinder-volume[86505]: INFO cinder.manager [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Service 3 cleanup completed. Jul 08 02:33:45 devstack cinder-volume[86505]: DEBUG cinder.service [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Creating RPC server for service cinder-volume {{(pid=86505) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 02:33:45 devstack cinder-volume[86505]: DEBUG cinder.service [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86505) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 02:33:45 devstack cinder-volume[86505]: INFO cinder.volume.manager [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 02:33:45 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:33:45 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:33:45 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=86505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:33:45 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=86505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:33:45 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:33:45 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:33:45 devstack sudo[86628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:33:45 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:33:46 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root Jul 08 02:33:46 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.757s {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:33:46 devstack cinder-volume[86505]: INFO cinder.volume.manager [None req-98390e1f-9a53-4a11-8dd4-bdde6261a83e None None] Driver post RPC initialization completed successfully. Jul 08 02:33:50 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-c16dbb4d-6b64-4282-83b2-764df6bd5129 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:33:50 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-c16dbb4d-6b64-4282-83b2-764df6bd5129 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:33:50 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-c16dbb4d-6b64-4282-83b2-764df6bd5129 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=86505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:33:50 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-c16dbb4d-6b64-4282-83b2-764df6bd5129 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=86505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:33:50 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-c16dbb4d-6b64-4282-83b2-764df6bd5129 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:33:50 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-c16dbb4d-6b64-4282-83b2-764df6bd5129 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:33:50 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:33:50 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:33:51 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Jul 08 02:33:51 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-c16dbb4d-6b64-4282-83b2-764df6bd5129 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.767s {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:33:51 devstack cinder-volume[86505]: DEBUG cinder.manager [None req-c16dbb4d-6b64-4282-83b2-764df6bd5129 None None] Notifying Schedulers of capabilities ... {{(pid=86505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:33:51 devstack cinder-volume[86289]: INFO oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Caught SIGTERM, stopping children Jul 08 02:33:51 devstack cinder-volume[86289]: DEBUG oslo_concurrency.lockutils [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Acquiring lock "singleton_lock" {{(pid=86289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 02:33:51 devstack cinder-volume[86289]: DEBUG oslo_concurrency.lockutils [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Acquired lock "singleton_lock" {{(pid=86289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 02:33:51 devstack cinder-volume[86289]: DEBUG oslo_concurrency.lockutils [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Releasing lock "singleton_lock" {{(pid=86289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 02:33:51 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Stop services. {{(pid=86289) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 02:33:51 devstack cinder-volume[86289]: DEBUG oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Killing children. {{(pid=86289) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 02:33:51 devstack cinder-volume[86289]: INFO oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Waiting on 1 children to exit Jul 08 02:33:53 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Acquiring lock "singleton_lock" {{(pid=86505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 02:33:53 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Acquired lock "singleton_lock" {{(pid=86505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 02:33:53 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Releasing lock "singleton_lock" {{(pid=86505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 02:33:53 devstack cinder-volume[86505]: WARNING amqp [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 02:33:53 devstack cinder-volume[86505]: WARNING amqp [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 02:33:53 devstack cinder-volume[86289]: INFO oslo_service.backend._eventlet.service [None req-a6d69732-571b-49fd-b82e-7c0fb418652d None None] Child 86505 exited with status 0 Jul 08 02:33:54 devstack cinder-volume[86945]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 02:33:54 devstack cinder-volume[86945]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 02:33:54 devstack cinder-volume[86945]: we strongly recommend against using it for new projects. Jul 08 02:33:54 devstack cinder-volume[86945]: If you are already using Eventlet, we recommend migrating to a different Jul 08 02:33:54 devstack cinder-volume[86945]: framework. For more detail see Jul 08 02:33:54 devstack cinder-volume[86945]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 02:33:54 devstack cinder-volume[86945]: import eventlet # noqa Jul 08 02:33:57 devstack cinder-volume[86945]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 02:33:57 devstack cinder-volume[86945]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 02:33:57 devstack cinder-volume[86945]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 02:33:58 devstack cinder-volume[86945]: INFO dbcounter [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] Registered counter for database cinder Jul 08 02:33:58 devstack cinder-volume[86945]: DEBUG oslo_db.sqlalchemy.engines [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86945) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG dbcounter [-] [86945] Writer thread running {{(pid=86945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 02:33:59 devstack cinder-volume[86945]: INFO cinder.rpc [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 02:33:59 devstack cinder-volume[86945]: INFO cinder.rpc [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_db.sqlalchemy.engines [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86945) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 02:33:59 devstack cinder-volume[86945]: INFO cinder.volume.manager [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] Determined volume DB was empty at startup. Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG cinder.volume.manager [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86945) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 02:33:59 devstack cinder-volume[86945]: WARNING stevedore.named [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 02:33:59 devstack cinder-volume[86945]: WARNING castellan.key_manager [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 02:33:59 devstack cinder-volume[86945]: WARNING cinder.keymgr.conf_key_mgr [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 02:33:59 devstack cinder-volume[86945]: INFO cinder.volume.manager [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_db.sqlalchemy.engines [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86945) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 02:33:59 devstack cinder-volume[86945]: INFO oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] Starting 1 workers Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] Started child 87238 {{(pid=86945) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] Full set of CONF: {{(pid=86945) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] ******************************************************************************** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] Configuration options gathered from: {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] ================================================================================ {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] allow_availability_zone_fallback = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] allow_compression_on_image_upload = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] allowed_direct_url_schemes = [] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] api_rate_limit = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] auth_strategy = keystone {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_availability_zone = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_host = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_name = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_stats_polling_interval = 60 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backup_api_class = cinder.backup.api.API {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backup_name_template = backup-%s {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backup_use_same_host = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backup_use_temp_snapshot = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] chap_password = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] chap_username = {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cinder_internal_tenant_project_id = 61b66e2e6267416eab714666819614b9 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cinder_internal_tenant_user_id = 0b554d939332496fb5008142e67a6323 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cluster = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] compression_format = gzip {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] compute_api_class = cinder.compute.nova.API {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] config_dir = [] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] config_source = [] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] control_exchange = openstack {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] debug = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] default_availability_zone = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] default_group_type = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] default_volume_type = QuobyteHD {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] disk_geometry = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] driver_client_cert = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] driver_client_cert_key = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] driver_data_namespace = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] driver_ssl_cert_path = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] driver_ssl_cert_verify = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] driver_use_ssl = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] enable_new_services = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] enable_unsupported_driver = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[87238]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] enabled_backends = ['QuobyteHD'] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] enforce_multipath_for_image_xfer = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] filter_function = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance_api_insecure = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance_api_servers = ['http://192.168.122.249/image'] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance_api_ssl_compression = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance_ca_certificates_file = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance_catalog_info = image:glance:publicURL {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance_certfile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance_keyfile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance_num_retries = 3 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance_request_timeout = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] goodness_function = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] graceful_shutdown_timeout = 5 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] group_api_class = cinder.group.api.API {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] host = devstack {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] image_compress_on_upload = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] image_conversion_address_space_limit = 1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] image_conversion_cpu_limit = 60 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] image_conversion_disable = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] image_upload_use_cinder_backend = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] image_upload_use_internal_tenant = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] image_volume_cache_enabled = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] image_volume_cache_max_count = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] image_volume_cache_max_size_gb = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] init_host_max_objects_retrieval = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] instance_format = [instance: %(uuid)s] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] iscsi_target_flags = {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] iscsi_write_cache = on {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] iser_helper = tgtadm {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] iser_ip_address = 192.168.122.249 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] iser_port = 3260 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] log_color = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] log_config_append = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] log_dir = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] log_file = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] log_options = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] log_rotate_interval = 1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] log_rotate_interval_type = days {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] log_rotation_type = none {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] max_age = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] max_logfile_count = 30 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] max_logfile_size_mb = 200 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] max_over_subscription_ratio = 20.0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] message_reap_interval = 86400 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] message_ttl = 2592000 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] migration_create_volume_timeout_secs = 300 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] monkey_patch = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] monkey_patch_modules = [] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] my_ip = 192.168.122.249 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] no_snapshot_gb_quota = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] num_iser_scan_tries = 3 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] num_shell_tries = 3 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] num_volume_device_scan_tries = 3 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] nvmeof_conn_info_version = 1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] nvmet_ns_id = 10 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] nvmet_port_id = 1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] osapi_max_limit = 1000 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] osapi_volume_ext_list = [] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] osapi_volume_listen_port = 8776 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] osapi_volume_use_ssl = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] osapi_volume_workers = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] per_volume_size_limit = -1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] periodic_fuzzy_delay = 60 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] periodic_interval = 60 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] public_endpoint = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] publish_errors = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] quota_backup_gigabytes = 1000 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] quota_backups = 10 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] quota_gigabytes = 1000 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] quota_groups = 10 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] quota_snapshots = 10 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] quota_volumes = 10 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] rate_limit_burst = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] rate_limit_except_level = CRITICAL {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] rate_limit_interval = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] reinit_driver_count = 3 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] replication_device = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] report_discard_supported = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] report_interval = 120 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] reservation_clean_interval = 86400 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] reservation_expire = 86400 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] reserved_image_namespaces = [] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] reserved_percentage = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] rpc_response_timeout = 120 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] run_external_periodic_tasks = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] scst_target_driver = iscsi {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] scst_target_iqn_name = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] service_down_time = 720 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] shell_completion = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] snapshot_name_template = snapshot-%s {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] split_loggers = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] state_path = /opt/stack/data/cinder {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] storage_availability_zone = nova {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] storage_protocol = iSCSI {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] syslog_log_facility = LOG_USER {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] target_helper = lioadm {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] target_ip_address = 192.168.122.249 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] target_port = 3260 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] target_protocol = iscsi {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] target_secondary_ip_addresses = [] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] trace_flags = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] transport_url = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] until_refresh = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] use_chap_auth = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] use_default_quota_class = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] use_journal = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] use_json = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] use_multipath_for_image_xfer = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] use_stderr = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] use_syslog = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] verify_glance_signatures = enabled {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] volume_api_class = cinder.volume.api.API {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] volume_backend_name = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] volume_clear = zero {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] volume_clear_ionice = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] volume_clear_size = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] volume_copy_bps_limit = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87238) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] volume_dd_blocksize = 1M {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] volume_name_template = volume-%s {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] volume_service_inithost_offload = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] volume_usage_audit_period = month {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] zoning_mode = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_concurrency.disable_process_locking = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.auth_section = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.auth_type = password {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.auth_version = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.cache = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.certfile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.include_service_catalog = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.insecure = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.interface = public {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.keyfile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcache_password = {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcache_username = {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.region_name = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.service_type = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.249/identity {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.backend = dogpile.cache.null {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.backend_argument = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.backend_expiration_time = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.config_prefix = cache.oslo {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.debug_cache_backend = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.enable_retry_client = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.enable_socket_keepalive = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.enabled = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.expiration_time = 600 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.hashclient_retry_attempts = 2 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.memcache_dead_retry = 300 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.memcache_pool_maxsize = 10 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.memcache_sasl_enabled = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.password = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.proxies = [] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.redis_db = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.redis_server = localhost:6379 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.retry_attempts = 2 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.retry_delay = 0.0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.socket_keepalive_count = 1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.socket_keepalive_idle = 1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.socket_keepalive_interval = 1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.socket_timeout = 1.0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.tls_allowed_ciphers = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.tls_cafile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.tls_certfile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.tls_enabled = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.tls_keyfile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cache.username = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] coordination.backend_url = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.asyncio_connection = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.asyncio_slave_connection = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.backend = sqlalchemy {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.connection = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.connection_debug = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.connection_parameters = {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.connection_recycle_time = 3600 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.connection_trace = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.db_inc_retry_interval = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.db_max_retries = 20 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87238) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 02:33:59 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.quobyte [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 02:33:59 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.quobyte [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.db_max_retry_interval = 10 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.db_retry_interval = 1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.max_overflow = 50 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.max_pool_size = 5 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.max_retries = 10 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Running cmd (subprocess): mount.quobyte {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.mysql_wsrep_sync_wait = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.pool_timeout = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.retry_interval = 10 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.slave_connection = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.sqlite_synchronous = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.synchronous_reader = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] database.use_db_reconnect = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] profiler.connection_string = messaging:// {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] profiler.enabled = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] profiler.es_doc_type = notification {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] profiler.es_scroll_size = 10000 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] profiler.es_scroll_time = 2m {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] profiler.filter_error_trace = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] profiler.hmac_keys = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] profiler.sentinel_service_name = mymaster {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] profiler.socket_timeout = 0.1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] profiler.trace_requests = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] profiler.trace_sqlalchemy = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] profiler_jaeger.process_tags = {} {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] profiler_jaeger.service_name_prefix = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] profiler_otlp.service_name_prefix = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_policy.enforce_new_defaults = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_policy.enforce_scope = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_policy.policy_default_rule = default {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_policy.policy_file = policy.yaml {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] privsep_osbrick.group = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] privsep_osbrick.helper_command = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] privsep_osbrick.user = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cinder_sys_admin.group = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cinder_sys_admin.helper_command = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] cinder_sys_admin.user = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] service_user.auth_section = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] service_user.auth_type = password {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] service_user.cafile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] service_user.certfile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] service_user.collect_timing = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] service_user.insecure = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] service_user.keyfile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] service_user.send_service_user_token = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] service_user.split_loggers = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] service_user.timeout = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance.auth_section = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance.auth_type = password {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance.certfile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance.collect_timing = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance.insecure = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance.keyfile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance.region_name = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance.split_loggers = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] glance.timeout = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.backend_availability_zone = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.chap_password = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.chap_username = {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.disk_geometry = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.driver_client_cert = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.driver_client_cert_key = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.driver_data_namespace = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.driver_use_ssl = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.extra_capabilities = {} {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.filter_function = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.goodness_function = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.iscsi_target_flags = {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.iscsi_write_cache = on {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.iser_helper = tgtadm {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.iser_ip_address = 192.168.122.249 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.iser_port = 3260 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.nas_host = {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.nas_login = admin {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.nas_mount_options = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.nas_password = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.nas_private_key = {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.nas_share_path = {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.num_shell_tries = 3 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.quobyte_volume_url = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.replication_device = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack quobyte-client[87240]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 02:33:59 devstack quobyte-client[87240]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.report_discard_supported = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.reserved_percentage = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] CMD "mount.quobyte" returned: 1 in 0.107s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.target_helper = tgtadm {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.target_ip_address = 192.168.122.249 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.target_port = 3260 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.target_protocol = iscsi {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.trace_flags = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.unique_fqdn_network = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.use_chap_auth = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.volume_backend_name = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.volume_clear = zero {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.volume_clear_ionice = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.volume_clear_size = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_reports.file_event_handler = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_reports.log_dir = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.backend_availability_zone = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.backend_host = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.chap_password = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.chap_username = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.chiscsi_conf = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.disk_geometry = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.driver_client_cert = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.driver_data_namespace = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.driver_use_ssl = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.extra_capabilities = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.filter_function = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.goodness_function = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.iser_helper = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.iser_ip_address = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.iser_port = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.iser_target_prefix = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.nas_host = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.nas_login = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.nas_mount_options = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.nas_password = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.nas_private_key = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.nas_share_path = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.nas_ssh_port = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.num_shell_tries = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.nvmet_port_id = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:33:59 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.replication_device = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.report_discard_supported = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.reserved_percentage = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.scst_target_driver = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.storage_protocol = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.target_helper = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.target_ip_address = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.target_port = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.target_prefix = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.target_protocol = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.trace_flags = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.use_chap_auth = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.volume_clear = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.volume_clear_size = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] QuobyteHD.volumes_dir = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.ssl = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_notifications.driver = [] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_notifications.retry = -1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] key_manager.fixed_key = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.barbican_api_version = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.barbican_endpoint = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.barbican_endpoint_type = public {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.barbican_region_name = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.cafile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.certfile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.collect_timing = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.insecure = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.keyfile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.number_of_retries = 60 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.retry_delay = 1 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.send_service_user_token = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.split_loggers = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.timeout = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.verify_ssl = True {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican.verify_ssl_path = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican_service_user.auth_section = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican_service_user.auth_type = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican_service_user.cafile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican_service_user.certfile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican_service_user.collect_timing = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican_service_user.insecure = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican_service_user.keyfile = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican_service_user.split_loggers = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] barbican_service_user.timeout = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] vault.approle_role_id = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] vault.approle_secret_id = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] vault.kv_mountpoint = secret {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] vault.kv_path = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] vault.kv_version = 2 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] vault.namespace = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] vault.root_token_id = **** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] vault.ssl_ca_crt_file = None {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] vault.timeout = 60.0 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] vault.use_ssl = False {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 02:33:59 devstack cinder-volume[86945]: DEBUG oslo_service.backend._eventlet.service [None req-b4f033d7-c77e-4e81-b86e-0d4b5c80bff5 None None] ******************************************************************************** {{(pid=86945) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 02:34:00 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Jul 08 02:34:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.746s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:34:00 devstack cinder-volume[87238]: INFO cinder.volume.driver [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 02:34:00 devstack cinder-volume[87238]: DEBUG cinder.volume.driver [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.710319519043, 'free_capacity_gb': 1775.710319519043, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87238) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 02:34:00 devstack cinder-volume[87238]: DEBUG oslo_db.sqlalchemy.engines [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87238) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 02:34:00 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writer thread running {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 02:34:00 devstack cinder-volume[87238]: DEBUG cinder.db.api [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Building query based on filter {{(pid=87238) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 02:34:00 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87238) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 02:34:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:34:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:34:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:34:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:34:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:34:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:34:00 devstack cinder-volume[87238]: INFO cinder.keymgr.migration [None req-a490a1cf-a22e-486d-bd4c-42976aff665f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 02:34:00 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:34:00 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:34:01 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Jul 08 02:34:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.773s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:34:01 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:34:01 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Driver initialization completed successfully. Jul 08 02:34:01 devstack cinder-volume[87238]: INFO cinder.manager [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Initiating service 3 cleanup Jul 08 02:34:01 devstack cinder-volume[87238]: INFO cinder.manager [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Service 3 cleanup completed. Jul 08 02:34:01 devstack cinder-volume[87238]: DEBUG cinder.service [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Creating RPC server for service cinder-volume {{(pid=87238) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 02:34:01 devstack cinder-volume[87238]: DEBUG cinder.service [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87238) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 02:34:01 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 02:34:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:34:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:34:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:34:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:34:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:34:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:34:01 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:34:01 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:34:02 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Jul 08 02:34:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.649s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:34:02 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-14f2a70a-4b1f-48f1-8318-2f024c4f1270 None None] Driver post RPC initialization completed successfully. Jul 08 02:34:09 devstack cinder-volume[86945]: DEBUG dbcounter [-] [86945] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:34:11 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=2 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:34:12 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:34:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:34:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 6 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:34:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Flow 'volume_create_manager' (7363409b-22d0-48aa-8f35-cca13e2cb645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f888ad7f-1d18-47b7-b9eb-cfc6a6eec696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f888ad7f-1d18-47b7-b9eb-cfc6a6eec696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1234497414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6413d7cd-596a-47e4-8aea-90b49cb9a564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a1ec615895435dabf3a2f4af6ee1dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:35:00Z,use_quota=True,user_id='d86b315d049e4f149500990bd16ffb64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22832f05-44ff-457e-a45d-1b45ac3c6ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22832f05-44ff-457e-a45d-1b45ac3c6ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d5ca2c-528d-4481-a3d5-30dc0030b1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d5ca2c-528d-4481-a3d5-30dc0030b1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6413d7cd-596a-47e4-8aea-90b49cb9a564', 'volume_name': 'volume-6413d7cd-596a-47e4-8aea-90b49cb9a564', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a3a7ea-b804-455a-b134-657009759f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a3a7ea-b804-455a-b134-657009759f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ba44cc-9256-4f5d-a715-7968fe3f6a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:00 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Volume 6413d7cd-596a-47e4-8aea-90b49cb9a564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6413d7cd-596a-47e4-8aea-90b49cb9a564', 'volume_size': 1} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1234497414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6413d7cd-596a-47e4-8aea-90b49cb9a564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a1ec615895435dabf3a2f4af6ee1dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:35:00Z,use_quota=True,user_id='d86b315d049e4f149500990bd16ffb64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Creating volume 6413d7cd-596a-47e4-8aea-90b49cb9a564 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:35:00 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:35:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6413d7cd-596a-47e4-8aea-90b49cb9a564 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:00 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6413d7cd-596a-47e4-8aea-90b49cb9a564 1073741824 Jul 08 02:35:00 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:02 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6413d7cd-596a-47e4-8aea-90b49cb9a564 1073741824" returned: 0 in 1.950s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6413d7cd-596a-47e4-8aea-90b49cb9a564 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:02 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6413d7cd-596a-47e4-8aea-90b49cb9a564 Jul 08 02:35:02 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:03 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:35:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Flow 'volume_create_manager' (9b0ae648-53c3-46aa-b7cd-c54002f12ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:35:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26f3817-ab93-45be-84b2-f64c061e0993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26f3817-ab93-45be-84b2-f64c061e0993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-660232293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c122b1ff-e89a-49d2-8231-f619704a2ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76eab35de2654437ae11822456f07bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:35:03Z,use_quota=True,user_id='596fbf980b0243fba57fd247189e44de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc8f42c-af7a-49fe-822d-474a61169b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc8f42c-af7a-49fe-822d-474a61169b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ea8868-da32-42b6-8b44-253a41b8b0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ea8868-da32-42b6-8b44-253a41b8b0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c122b1ff-e89a-49d2-8231-f619704a2ad9', 'volume_name': 'volume-c122b1ff-e89a-49d2-8231-f619704a2ad9', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8024ed-4804-4593-b547-79e65bda6ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8024ed-4804-4593-b547-79e65bda6ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b5d853-6444-418a-80c8-5b6ac28cf640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:03 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Volume c122b1ff-e89a-49d2-8231-f619704a2ad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c122b1ff-e89a-49d2-8231-f619704a2ad9', 'volume_size': 1} Jul 08 02:35:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:35:04 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6413d7cd-596a-47e4-8aea-90b49cb9a564" returned: 0 in 1.607s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] <== create_volume: return (3785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.788s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.704s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-660232293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c122b1ff-e89a-49d2-8231-f619704a2ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76eab35de2654437ae11822456f07bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:35:03Z,use_quota=True,user_id='596fbf980b0243fba57fd247189e44de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Creating volume c122b1ff-e89a-49d2-8231-f619704a2ad9 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:35:04 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c122b1ff-e89a-49d2-8231-f619704a2ad9 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ba44cc-9256-4f5d-a715-7968fe3f6a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6413d7cd-596a-47e4-8aea-90b49cb9a564', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8a59fe-ff9e-481c-98c8-fb487ef61b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:04 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c122b1ff-e89a-49d2-8231-f619704a2ad9 1073741824 Jul 08 02:35:04 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:04 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Volume volume-6413d7cd-596a-47e4-8aea-90b49cb9a564 (6413d7cd-596a-47e4-8aea-90b49cb9a564): created successfully Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8a59fe-ff9e-481c-98c8-fb487ef61b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Flow 'volume_create_manager' (7363409b-22d0-48aa-8f35-cca13e2cb645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:35:04 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-da739856-d6d4-40d5-bbce-463a4b768548 tempest-TaggedAttachmentsTest-2047410959 None] Created volume successfully. Jul 08 02:35:05 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c122b1ff-e89a-49d2-8231-f619704a2ad9 1073741824" returned: 0 in 1.308s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c122b1ff-e89a-49d2-8231-f619704a2ad9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:05 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c122b1ff-e89a-49d2-8231-f619704a2ad9 Jul 08 02:35:05 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:07 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c122b1ff-e89a-49d2-8231-f619704a2ad9" returned: 0 in 1.442s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] <== create_volume: return (2806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:35:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.817s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:35:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b5d853-6444-418a-80c8-5b6ac28cf640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c122b1ff-e89a-49d2-8231-f619704a2ad9', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4dc925-2e5e-486a-baf6-71e53d9583c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:07 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Volume volume-c122b1ff-e89a-49d2-8231-f619704a2ad9 (c122b1ff-e89a-49d2-8231-f619704a2ad9): created successfully Jul 08 02:35:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4dc925-2e5e-486a-baf6-71e53d9583c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Flow 'volume_create_manager' (9b0ae648-53c3-46aa-b7cd-c54002f12ca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:35:07 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-4e24212c-a366-4ecf-ac26-562c537857ad tempest-DeleteServersTestJSON-306094379 None] Created volume successfully. Jul 08 02:35:16 devstack cinder-volume[87238]: WARNING py.warnings [req-89037c74-fb34-4ce1-97ff-98e42cf7e217 req-23a9a809-bcca-432d-8c04-3635709abfc5 tempest-DeleteServersTestJSON-306094379 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 08 02:35:16 devstack cinder-volume[87238]: .first() Jul 08 02:35:16 devstack cinder-volume[87238]: Jul 08 02:35:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-89037c74-fb34-4ce1-97ff-98e42cf7e217 req-23a9a809-bcca-432d-8c04-3635709abfc5 tempest-DeleteServersTestJSON-306094379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:35:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-89037c74-fb34-4ce1-97ff-98e42cf7e217 req-23a9a809-bcca-432d-8c04-3635709abfc5 tempest-DeleteServersTestJSON-306094379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:35:16 devstack cinder-volume[87238]: INFO oslo.privsep.daemon [req-89037c74-fb34-4ce1-97ff-98e42cf7e217 req-23a9a809-bcca-432d-8c04-3635709abfc5 tempest-DeleteServersTestJSON-306094379 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpj3y_dnrk/privsep.sock'] Jul 08 02:35:16 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpj3y_dnrk/privsep.sock Jul 08 02:35:16 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 02:35:17 devstack cinder-volume[87238]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 08 02:35:18 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:18 devstack cinder-volume[87238]: INFO oslo.privsep.daemon [req-89037c74-fb34-4ce1-97ff-98e42cf7e217 req-23a9a809-bcca-432d-8c04-3635709abfc5 tempest-DeleteServersTestJSON-306094379 None] Spawned new privsep daemon via rootwrap Jul 08 02:35:18 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [req-89037c74-fb34-4ce1-97ff-98e42cf7e217 req-23a9a809-bcca-432d-8c04-3635709abfc5 tempest-DeleteServersTestJSON-306094379 None] Accepted privsep connection to /tmp/tmpj3y_dnrk/privsep.sock {{(pid=87238) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 08 02:35:18 devstack cinder-volume[87238]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 08 02:35:18 devstack cinder-volume[87238]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 08 02:35:18 devstack cinder-volume[87238]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 08 02:35:18 devstack cinder-volume[87238]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88198 Jul 08 02:35:18 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[273b9001-60f9-4836-81a9-398cddd43136]: (2,) {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:35:18 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb20f28-33d3-4b38-bdee-0ed0e68af3d6]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:35:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-89037c74-fb34-4ce1-97ff-98e42cf7e217 req-23a9a809-bcca-432d-8c04-3635709abfc5 tempest-DeleteServersTestJSON-306094379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c122b1ff-e89a-49d2-8231-f619704a2ad9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:18 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c122b1ff-e89a-49d2-8231-f619704a2ad9 Jul 08 02:35:18 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:19 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-89037c74-fb34-4ce1-97ff-98e42cf7e217 req-23a9a809-bcca-432d-8c04-3635709abfc5 tempest-DeleteServersTestJSON-306094379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c122b1ff-e89a-49d2-8231-f619704a2ad9" returned: 0 in 0.907s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-89037c74-fb34-4ce1-97ff-98e42cf7e217 req-23a9a809-bcca-432d-8c04-3635709abfc5 tempest-DeleteServersTestJSON-306094379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.735s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:35:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-89037c74-fb34-4ce1-97ff-98e42cf7e217 req-23a9a809-bcca-432d-8c04-3635709abfc5 tempest-DeleteServersTestJSON-306094379 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-c122b1ff-e89a-49d2-8231-f619704a2ad9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4b8ccbf-85aa-486b-a389-1d0b505114d9', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:35:19 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-89037c74-fb34-4ce1-97ff-98e42cf7e217 req-23a9a809-bcca-432d-8c04-3635709abfc5 tempest-DeleteServersTestJSON-306094379 None] attachment_update completed successfully. Jul 08 02:35:29 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-0d0f83ff-81d4-4591-a4c8-4229e5fb558d req-3d234fd8-c8ac-4dfb-86bb-94bb8f9924bf tempest-DeleteServersTestJSON-306094379 None] Terminate volume connection completed successfully. Jul 08 02:35:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-0d0f83ff-81d4-4591-a4c8-4229e5fb558d req-3d234fd8-c8ac-4dfb-86bb-94bb8f9924bf tempest-DeleteServersTestJSON-306094379 None] Deleting attachment a4b8ccbf-85aa-486b-a389-1d0b505114d9. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:35:29 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=7,cinder:SELECT=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Flow 'volume_create_manager' (8cb64735-b41f-4555-b42f-c2d376dc85b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf335a0-6108-4534-82f9-829092acf7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf335a0-6108-4534-82f9-829092acf7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1373516581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb648230-5b2a-4efa-bc0e-dacc64822a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3b5b45f19243378e7a6c9d093f8619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:35:33Z,use_quota=True,user_id='6ad98c44483d466aab7821c2b75da0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9660b5-96bd-4c90-9b42-c677ac0e123d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9660b5-96bd-4c90-9b42-c677ac0e123d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3528a3-7596-46c3-a500-a4756302ebf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3528a3-7596-46c3-a500-a4756302ebf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb648230-5b2a-4efa-bc0e-dacc64822a5d', 'volume_name': 'volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8a9fa8-19bc-4f1a-80b1-bc8aefca42b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8a9fa8-19bc-4f1a-80b1-bc8aefca42b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a507637d-154b-4a76-b824-e1df48db1b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:33 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Volume cb648230-5b2a-4efa-bc0e-dacc64822a5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d', 'volume_size': 1} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1373516581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb648230-5b2a-4efa-bc0e-dacc64822a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3b5b45f19243378e7a6c9d093f8619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:35:33Z,use_quota=True,user_id='6ad98c44483d466aab7821c2b75da0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Creating volume cb648230-5b2a-4efa-bc0e-dacc64822a5d {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:35:33 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:35:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:33 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d 1073741824 Jul 08 02:35:33 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Acquiring lock "cinder-c122b1ff-e89a-49d2-8231-f619704a2ad9-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:35:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Lock "cinder-c122b1ff-e89a-49d2-8231-f619704a2ad9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:35:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Acquiring lock "cinder-quobyte-c122b1ff-e89a-49d2-8231-f619704a2ad9" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:35:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Lock "cinder-quobyte-c122b1ff-e89a-49d2-8231-f619704a2ad9" acquired by "delete_volume" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:35:34 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a358101c-f0bf-4503-9757-f770b1b48800]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:35:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c122b1ff-e89a-49d2-8231-f619704a2ad9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:34 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c122b1ff-e89a-49d2-8231-f619704a2ad9 Jul 08 02:35:34 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:34 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d 1073741824" returned: 0 in 1.378s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:34 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d Jul 08 02:35:34 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:35 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c122b1ff-e89a-49d2-8231-f619704a2ad9" returned: 0 in 1.220s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c122b1ff-e89a-49d2-8231-f619704a2ad9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:35 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c122b1ff-e89a-49d2-8231-f619704a2ad9 Jul 08 02:35:35 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:36 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d" returned: 0 in 1.637s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:36 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] <== create_volume: return (3087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:35:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.094s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:35:36 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a507637d-154b-4a76-b824-e1df48db1b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:36 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a5eaf7-740e-4440-9d9b-5a9499fed0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:36 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Volume volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d (cb648230-5b2a-4efa-bc0e-dacc64822a5d): created successfully Jul 08 02:35:36 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a5eaf7-740e-4440-9d9b-5a9499fed0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:36 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Flow 'volume_create_manager' (8cb64735-b41f-4555-b42f-c2d376dc85b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:35:36 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3780363d-2095-4668-a5d2-1591ca062c2c tempest-AttachVolumeNegativeTest-1281536783 None] Created volume successfully. Jul 08 02:35:36 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c122b1ff-e89a-49d2-8231-f619704a2ad9" returned: 0 in 1.207s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Lock "cinder-quobyte-c122b1ff-e89a-49d2-8231-f619704a2ad9" released by "delete_volume" :: held 2.514s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:35:37 devstack cinder-volume[87238]: WARNING cinder.quota [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:35:37 devstack cinder-volume[87238]: WARNING cinder.quota [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:35:37 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Created reservations ['11af4a32-ab89-47b4-b9a2-5776884ec5f7', '7e927518-578d-4c52-9bc3-f41846d02e04', '4e6d588f-028d-44fb-a73d-17a851588a18', 'aa830f04-1737-4513-8545-49ad9050c2dd'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:35:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:35:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:35:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:35:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:35:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:35:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:37 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:35:37 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:38 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.951s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:38 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:35:38 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Deleted volume successfully. Jul 08 02:35:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4d55fdb2-d1e6-429d-94dc-de301fac5f42 tempest-DeleteServersTestJSON-306094379 None] Lock "cinder-c122b1ff-e89a-49d2-8231-f619704a2ad9-delete_volume" released by "delete_volume" :: held 3.970s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:35:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-0243753b-ead0-430f-9168-eb385aa11a4f req-48a7fff7-c4b9-4c54-bf93-52cb74deb942 tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:35:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-0243753b-ead0-430f-9168-eb385aa11a4f req-48a7fff7-c4b9-4c54-bf93-52cb74deb942 tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:35:41 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c713a1-efd8-404a-8a98-d0730c000edd]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:35:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-0243753b-ead0-430f-9168-eb385aa11a4f req-48a7fff7-c4b9-4c54-bf93-52cb74deb942 tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:41 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d Jul 08 02:35:41 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:42 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-0243753b-ead0-430f-9168-eb385aa11a4f req-48a7fff7-c4b9-4c54-bf93-52cb74deb942 tempest-AttachVolumeNegativeTest-1281536783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d" returned: 0 in 1.192s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-0243753b-ead0-430f-9168-eb385aa11a4f req-48a7fff7-c4b9-4c54-bf93-52cb74deb942 tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.236s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:35:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-0243753b-ead0-430f-9168-eb385aa11a4f req-48a7fff7-c4b9-4c54-bf93-52cb74deb942 tempest-AttachVolumeNegativeTest-1281536783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0ad5804-8686-4f18-9602-50f68e32527e', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:35:42 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-0243753b-ead0-430f-9168-eb385aa11a4f req-48a7fff7-c4b9-4c54-bf93-52cb74deb942 tempest-AttachVolumeNegativeTest-1281536783 None] attachment_update completed successfully. Jul 08 02:35:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:35:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:35:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:35:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:35:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:35:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:35:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:47 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:35:47 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:48 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.917s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:35:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:35:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 8 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:35:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Flow 'volume_create_manager' (411f5315-49e3-4955-8627-d2a743ad6106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1271bc-2407-4e84-9952-7da8a1f828e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1271bc-2407-4e84-9952-7da8a1f828e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2006504052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a982a8-c815-495d-9712-3de3c2cf8c5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34a23962fb7c4a26b1766d6e71f0af12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:35:50Z,use_quota=True,user_id='ca4104d30bef4198baf30b76ca9e768b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5fccc1-3c63-4a29-bb45-037e69eca223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5fccc1-3c63-4a29-bb45-037e69eca223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207f67ad-26ef-4569-88b1-2476ff0980a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207f67ad-26ef-4569-88b1-2476ff0980a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a982a8-c815-495d-9712-3de3c2cf8c5a', 'volume_name': 'volume-54a982a8-c815-495d-9712-3de3c2cf8c5a', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b34571d-68ed-4a36-88b8-343c5ced22da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b34571d-68ed-4a36-88b8-343c5ced22da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461511fd-73c9-4932-9a31-01e5cfb21daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:50 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Volume 54a982a8-c815-495d-9712-3de3c2cf8c5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a982a8-c815-495d-9712-3de3c2cf8c5a', 'volume_size': 1} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2006504052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a982a8-c815-495d-9712-3de3c2cf8c5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34a23962fb7c4a26b1766d6e71f0af12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:35:50Z,use_quota=True,user_id='ca4104d30bef4198baf30b76ca9e768b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Creating volume 54a982a8-c815-495d-9712-3de3c2cf8c5a {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:35:50 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:35:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54a982a8-c815-495d-9712-3de3c2cf8c5a 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:50 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54a982a8-c815-495d-9712-3de3c2cf8c5a 1073741824 Jul 08 02:35:50 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:51 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54a982a8-c815-495d-9712-3de3c2cf8c5a 1073741824" returned: 0 in 1.064s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54a982a8-c815-495d-9712-3de3c2cf8c5a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:51 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54a982a8-c815-495d-9712-3de3c2cf8c5a Jul 08 02:35:51 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:52 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54a982a8-c815-495d-9712-3de3c2cf8c5a" returned: 0 in 0.822s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:35:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:35:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461511fd-73c9-4932-9a31-01e5cfb21daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a982a8-c815-495d-9712-3de3c2cf8c5a', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975dc785-42b3-4baf-9949-513a1ee0da0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:35:52 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Volume volume-54a982a8-c815-495d-9712-3de3c2cf8c5a (54a982a8-c815-495d-9712-3de3c2cf8c5a): created successfully Jul 08 02:35:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975dc785-42b3-4baf-9949-513a1ee0da0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:35:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Flow 'volume_create_manager' (411f5315-49e3-4955-8627-d2a743ad6106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:35:52 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-a4df1ed4-bf91-4870-a070-4dc7284ebdb0 req-64d83d47-2739-4d8e-a808-57ca914efc73 tempest-VolumesGetTestJSON-1464641515 None] Created volume successfully. Jul 08 02:35:52 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=24,cinder:INSERT=3,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:35:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Acquiring lock "cinder-54a982a8-c815-495d-9712-3de3c2cf8c5a-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:35:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Lock "cinder-54a982a8-c815-495d-9712-3de3c2cf8c5a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:35:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Acquiring lock "cinder-quobyte-54a982a8-c815-495d-9712-3de3c2cf8c5a" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:35:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Lock "cinder-quobyte-54a982a8-c815-495d-9712-3de3c2cf8c5a" acquired by "delete_volume" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:35:54 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[48871866-af22-4528-a4b4-98b50e509b9e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:35:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54a982a8-c815-495d-9712-3de3c2cf8c5a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:54 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54a982a8-c815-495d-9712-3de3c2cf8c5a Jul 08 02:35:54 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:55 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54a982a8-c815-495d-9712-3de3c2cf8c5a" returned: 0 in 0.837s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54a982a8-c815-495d-9712-3de3c2cf8c5a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:55 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54a982a8-c815-495d-9712-3de3c2cf8c5a Jul 08 02:35:55 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:55 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54a982a8-c815-495d-9712-3de3c2cf8c5a" returned: 0 in 0.728s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Lock "cinder-quobyte-54a982a8-c815-495d-9712-3de3c2cf8c5a" released by "delete_volume" :: held 1.618s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:35:55 devstack cinder-volume[87238]: DEBUG cinder.quota [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Created reservations ['dbaac238-2eca-4e29-9f61-9227f31b9342', '29fcd65a-0e0e-4453-9276-e6eb043dab9f', '8f79d150-44f3-4073-85af-3b5248a29614', '708211b0-769f-4aca-9d46-a30e75b0b342'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:35:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:35:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:35:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:35:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:35:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:35:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:35:55 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:35:55 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:35:56 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Jul 08 02:35:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.701s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:35:56 devstack cinder-volume[87238]: DEBUG cinder.manager [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:35:56 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Deleted volume successfully. Jul 08 02:35:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-ba878e0c-acc8-4185-b509-229d549131d2 req-02492bae-304c-443d-9e86-80155c3b9cd6 tempest-VolumesGetTestJSON-1464641515 None] Lock "cinder-54a982a8-c815-495d-9712-3de3c2cf8c5a-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:36:06 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=20,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:36:12 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:36:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-ff45b71e-94e3-4dfe-a0e4-f644dd84ace3 req-07f8096b-4bfe-45bf-baae-af5fde4e30f4 tempest-TaggedAttachmentsTest-2047410959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:36:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-ff45b71e-94e3-4dfe-a0e4-f644dd84ace3 req-07f8096b-4bfe-45bf-baae-af5fde4e30f4 tempest-TaggedAttachmentsTest-2047410959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:36:18 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[173ae07d-af1c-47f7-9dcb-e15c110cb0d1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:36:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-ff45b71e-94e3-4dfe-a0e4-f644dd84ace3 req-07f8096b-4bfe-45bf-baae-af5fde4e30f4 tempest-TaggedAttachmentsTest-2047410959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6413d7cd-596a-47e4-8aea-90b49cb9a564 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:18 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6413d7cd-596a-47e4-8aea-90b49cb9a564 Jul 08 02:36:18 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:19 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-ff45b71e-94e3-4dfe-a0e4-f644dd84ace3 req-07f8096b-4bfe-45bf-baae-af5fde4e30f4 tempest-TaggedAttachmentsTest-2047410959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6413d7cd-596a-47e4-8aea-90b49cb9a564" returned: 0 in 1.179s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-ff45b71e-94e3-4dfe-a0e4-f644dd84ace3 req-07f8096b-4bfe-45bf-baae-af5fde4e30f4 tempest-TaggedAttachmentsTest-2047410959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.263s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:36:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-ff45b71e-94e3-4dfe-a0e4-f644dd84ace3 req-07f8096b-4bfe-45bf-baae-af5fde4e30f4 tempest-TaggedAttachmentsTest-2047410959 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-6413d7cd-596a-47e4-8aea-90b49cb9a564', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ec58efa-6a53-4c2a-871b-f585b5874e9b', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:36:19 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-ff45b71e-94e3-4dfe-a0e4-f644dd84ace3 req-07f8096b-4bfe-45bf-baae-af5fde4e30f4 tempest-TaggedAttachmentsTest-2047410959 None] attachment_update completed successfully. Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Flow 'volume_create_manager' (ca4bac99-dcd8-4b2f-92a7-0e8755a03af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14212ea8-ec88-44eb-b4cf-30132edd58a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14212ea8-ec88-44eb-b4cf-30132edd58a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-768798383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8e67d7-ae59-4913-8189-cee8ffe81fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d9927c8b294ff79a20cc9327ce3cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:36:21Z,use_quota=True,user_id='ba3d94efd2474da6912151c80de54602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824a7e94-82c0-4568-b3da-7b7f40cebf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824a7e94-82c0-4568-b3da-7b7f40cebf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae810a0d-604a-4a61-8f49-5287604dc8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae810a0d-604a-4a61-8f49-5287604dc8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd8e67d7-ae59-4913-8189-cee8ffe81fbb', 'volume_name': 'volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e3b3c1-e35a-4703-b8bf-45bd1f2c909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e3b3c1-e35a-4703-b8bf-45bd1f2c909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ee6e88-96da-42cb-ab75-ee05ce196769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:36:20 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Volume dd8e67d7-ae59-4913-8189-cee8ffe81fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb', 'volume_size': 1} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-768798383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8e67d7-ae59-4913-8189-cee8ffe81fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d9927c8b294ff79a20cc9327ce3cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:36:21Z,use_quota=True,user_id='ba3d94efd2474da6912151c80de54602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Creating volume dd8e67d7-ae59-4913-8189-cee8ffe81fbb {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:36:20 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:36:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:20 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb 1073741824 Jul 08 02:36:20 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:21 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb 1073741824" returned: 0 in 0.985s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:21 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb Jul 08 02:36:21 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:22 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" returned: 0 in 0.678s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:36:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:36:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ee6e88-96da-42cb-ab75-ee05ce196769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:36:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51dfe95f-b68c-4c51-aec1-cb61ef9f13ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:36:22 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Volume volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb (dd8e67d7-ae59-4913-8189-cee8ffe81fbb): created successfully Jul 08 02:36:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51dfe95f-b68c-4c51-aec1-cb61ef9f13ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:36:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Flow 'volume_create_manager' (ca4bac99-dcd8-4b2f-92a7-0e8755a03af2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:36:22 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e51833c7-a55d-4e13-87ac-9a5b971ea4ab tempest-SnapshotsActionsTest-1572096789 None] Created volume successfully. Jul 08 02:36:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:36:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:36:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] Creating offline snapshot adab52b1-6fa9-4666-af9e-49041971b59f of volume dd8e67d7-ae59-4913-8189-cee8ffe81fbb {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:36:23 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[37005dc2-4ee6-4c59-b901-88eeb7140802]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:36:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:23 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb Jul 08 02:36:23 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:24 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" returned: 0 in 0.980s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:24 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f 1G Jul 08 02:36:24 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:25 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f 1G" returned: 0 in 0.982s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:25 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f Jul 08 02:36:25 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:25 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f" returned: 0 in 0.808s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:25 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f is being set with open permissions: ugo+rw Jul 08 02:36:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:25 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f Jul 08 02:36:25 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:26 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f" returned: 0 in 0.692s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:26 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.info Jul 08 02:36:26 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:27 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.info" returned: 0 in 0.710s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:27 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.info is being set with open permissions: ugo+rw Jul 08 02:36:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:27 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.info Jul 08 02:36:27 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:28 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.info" returned: 0 in 0.726s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.039s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:36:28 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f4990b47-ee21-4b75-81cd-a2671182109c tempest-SnapshotsActionsTest-1572096789 None] Create snapshot completed successfully Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Flow 'volume_create_manager' (0a916788-7c48-42a7-a857-d6c9b9e71c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfc1445-978a-4f4a-820d-47783eba2bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1c2634fd-9613-4de6-92cd-0f6abcff1805 tempest-SnapshotsActionsTest-1572096789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1c2634fd-9613-4de6-92cd-0f6abcff1805 tempest-SnapshotsActionsTest-1572096789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfc1445-978a-4f4a-820d-47783eba2bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1527211658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88427c0-01ac-4d17-a2a0-0183b3b58240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe57aeb467c4a118ac4a429148df22d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:36:29Z,use_quota=True,user_id='21b1756c307642bfbc0e705844bfd331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d99209-4e50-419e-bb4a-72838bafa70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d99209-4e50-419e-bb4a-72838bafa70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1596a81c-6470-41b1-ae86-634e220de777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1596a81c-6470-41b1-ae86-634e220de777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b88427c0-01ac-4d17-a2a0-0183b3b58240', 'volume_name': 'volume-b88427c0-01ac-4d17-a2a0-0183b3b58240', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e72f117-fe23-4e42-b904-27ddb3d3b48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e72f117-fe23-4e42-b904-27ddb3d3b48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d8fd87-e805-470a-a5fd-c36d1aace033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:36:29 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Volume b88427c0-01ac-4d17-a2a0-0183b3b58240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b88427c0-01ac-4d17-a2a0-0183b3b58240', 'volume_size': 1} Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-1c2634fd-9613-4de6-92cd-0f6abcff1805 tempest-SnapshotsActionsTest-1572096789 None] Creating offline snapshot 3652b371-a2df-4cd3-b93b-1b69f6185dcd of volume dd8e67d7-ae59-4913-8189-cee8ffe81fbb {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:36:29 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-af0929d3-c80a-4801-91df-1414d81d0ecc req-875bf181-013f-4942-adf9-aaf4e9175f95 tempest-TaggedAttachmentsTest-2047410959 None] Terminate volume connection completed successfully. Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-af0929d3-c80a-4801-91df-1414d81d0ecc req-875bf181-013f-4942-adf9-aaf4e9175f95 tempest-TaggedAttachmentsTest-2047410959 None] Deleting attachment 7ec58efa-6a53-4c2a-871b-f585b5874e9b. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d05dac-fbc8-4c11-8328-e330b19fd343]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:36:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1c2634fd-9613-4de6-92cd-0f6abcff1805 tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:29 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f Jul 08 02:36:29 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:30 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1c2634fd-9613-4de6-92cd-0f6abcff1805 tempest-SnapshotsActionsTest-1572096789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f" returned: 0 in 0.862s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-1c2634fd-9613-4de6-92cd-0f6abcff1805 tempest-SnapshotsActionsTest-1572096789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:36:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1c2634fd-9613-4de6-92cd-0f6abcff1805 tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:30 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd 1G Jul 08 02:36:30 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:31 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1c2634fd-9613-4de6-92cd-0f6abcff1805 tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd 1G" returned: 0 in 0.981s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1c2634fd-9613-4de6-92cd-0f6abcff1805 tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:31 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd Jul 08 02:36:31 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:31 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1c2634fd-9613-4de6-92cd-0f6abcff1805 tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd" returned: 0 in 0.712s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:31 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-1c2634fd-9613-4de6-92cd-0f6abcff1805 tempest-SnapshotsActionsTest-1572096789 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd is being set with open permissions: ugo+rw Jul 08 02:36:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1c2634fd-9613-4de6-92cd-0f6abcff1805 tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:31 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd Jul 08 02:36:31 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:32 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1c2634fd-9613-4de6-92cd-0f6abcff1805 tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd" returned: 0 in 0.804s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1c2634fd-9613-4de6-92cd-0f6abcff1805 tempest-SnapshotsActionsTest-1572096789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.521s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:36:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.477s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:36:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1527211658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88427c0-01ac-4d17-a2a0-0183b3b58240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe57aeb467c4a118ac4a429148df22d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:36:29Z,use_quota=True,user_id='21b1756c307642bfbc0e705844bfd331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:36:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Creating volume b88427c0-01ac-4d17-a2a0-0183b3b58240 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:36:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:36:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:36:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:36:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:36:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:36:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:36:32 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:36:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b88427c0-01ac-4d17-a2a0-0183b3b58240 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:32 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b88427c0-01ac-4d17-a2a0-0183b3b58240 1073741824 Jul 08 02:36:32 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:32 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-1c2634fd-9613-4de6-92cd-0f6abcff1805 tempest-SnapshotsActionsTest-1572096789 None] Create snapshot completed successfully Jul 08 02:36:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Acquiring lock "cinder-3652b371-a2df-4cd3-b93b-1b69f6185dcd-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:36:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-3652b371-a2df-4cd3-b93b-1b69f6185dcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:36:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Acquiring lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:36:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:36:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Acquiring lock "cinder-quobyte-3652b371-a2df-4cd3-b93b-1b69f6185dcd" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:36:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-quobyte-3652b371-a2df-4cd3-b93b-1b69f6185dcd" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:36:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Deleting offline snapshot 3652b371-a2df-4cd3-b93b-1b69f6185dcd of volume dd8e67d7-ae59-4913-8189-cee8ffe81fbb {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:36:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] snapshot_file for this snap is: volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:36:33 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2735da-f98d-4fb1-9188-a8f20ed094e7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:36:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:33 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd Jul 08 02:36:33 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:34 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b88427c0-01ac-4d17-a2a0-0183b3b58240 1073741824" returned: 0 in 1.408s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b88427c0-01ac-4d17-a2a0-0183b3b58240 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:34 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b88427c0-01ac-4d17-a2a0-0183b3b58240 Jul 08 02:36:34 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:34 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd" returned: 0 in 1.053s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:34 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:36:34 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[98826290-9dfa-4611-b1c3-405849ad60ab]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:36:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:35 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f Jul 08 02:36:35 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:35 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b88427c0-01ac-4d17-a2a0-0183b3b58240" returned: 0 in 0.993s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] <== create_volume: return (2472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:36:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.482s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:36:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d8fd87-e805-470a-a5fd-c36d1aace033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88427c0-01ac-4d17-a2a0-0183b3b58240', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:36:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0737b58-4910-46e5-a818-b6af9ecce039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:36:35 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Volume volume-b88427c0-01ac-4d17-a2a0-0183b3b58240 (b88427c0-01ac-4d17-a2a0-0183b3b58240): created successfully Jul 08 02:36:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0737b58-4910-46e5-a818-b6af9ecce039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:36:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Flow 'volume_create_manager' (0a916788-7c48-42a7-a857-d6c9b9e71c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:36:35 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-eb84f47c-75b9-4c09-b160-abcf0a0e880e tempest-VolumesAdminNegativeTest-1154893134 None] Created volume successfully. Jul 08 02:36:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Acquiring lock "cinder-b88427c0-01ac-4d17-a2a0-0183b3b58240-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:36:36 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f" returned: 0 in 1.312s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:36 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:36:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Lock "cinder-b88427c0-01ac-4d17-a2a0-0183b3b58240-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:36:36 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd Jul 08 02:36:36 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Acquiring lock "cinder-quobyte-b88427c0-01ac-4d17-a2a0-0183b3b58240" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:36:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Lock "cinder-quobyte-b88427c0-01ac-4d17-a2a0-0183b3b58240" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:36:36 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[43231f08-f23d-472d-9839-e0aa589bbfe2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:36:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b88427c0-01ac-4d17-a2a0-0183b3b58240 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:36 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b88427c0-01ac-4d17-a2a0-0183b3b58240 Jul 08 02:36:36 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:37 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b88427c0-01ac-4d17-a2a0-0183b3b58240" returned: 0 in 1.469s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b88427c0-01ac-4d17-a2a0-0183b3b58240 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:38 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b88427c0-01ac-4d17-a2a0-0183b3b58240 Jul 08 02:36:38 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:38 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd" returned: 0 in 1.883s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:38 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd Jul 08 02:36:38 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:39 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.3652b371-a2df-4cd3-b93b-1b69f6185dcd" returned: 0 in 1.043s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:39 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-quobyte-3652b371-a2df-4cd3-b93b-1b69f6185dcd" released by "_delete_snapshot" :: held 5.471s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:36:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b88427c0-01ac-4d17-a2a0-0183b3b58240" returned: 0 in 1.205s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" released by "delete_snapshot" :: held 5.519s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:36:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Lock "cinder-quobyte-b88427c0-01ac-4d17-a2a0-0183b3b58240" released by "delete_volume" :: held 2.761s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:36:39 devstack cinder-volume[87238]: WARNING cinder.quota [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:36:39 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Created reservations ['828b8740-eac3-4c5d-acb5-db2306f3dbc9', '3eebcada-b486-4d3a-b2da-0f13ead32f3e', '801f109b-f837-4d17-a48a-2384f4ae6a4b', '43179ce0-41a7-463f-8f47-0e0ad6ac69c1'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:36:39 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Created reservations ['a7337cc2-1392-4078-a1fb-c5583b386fbe', 'e6d04724-ed54-446e-8063-e189280d6435', '1f082fe7-4065-4e62-828e-a33b1b730b0b', '0b490590-b850-4862-ae12-4f6b276d1f2a'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:36:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:36:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:36:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:36:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:36:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:36:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:39 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:36:39 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:39 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Delete snapshot completed successfully. Jul 08 02:36:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2ba41c94-2f26-4efe-a7eb-170dfac39dfe tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-3652b371-a2df-4cd3-b93b-1b69f6185dcd-delete_snapshot" released by "delete_snapshot" :: held 5.777s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:36:40 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.820s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:40 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:36:40 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Deleted volume successfully. Jul 08 02:36:40 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b5e3dfe-8a34-488b-86f2-47fb1957df6f tempest-VolumesAdminNegativeTest-1154893134 None] Lock "cinder-b88427c0-01ac-4d17-a2a0-0183b3b58240-delete_volume" released by "delete_volume" :: held 3.932s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:36:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b898dfaf-6509-4075-beb4-d0c70b7e1225 tempest-SnapshotsActionsTest-1572096789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:36:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b898dfaf-6509-4075-beb4-d0c70b7e1225 tempest-SnapshotsActionsTest-1572096789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:36:40 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-b898dfaf-6509-4075-beb4-d0c70b7e1225 tempest-SnapshotsActionsTest-1572096789 None] Creating offline snapshot 6883dadc-a020-49f1-a448-9bd0fbc8fc46 of volume dd8e67d7-ae59-4913-8189-cee8ffe81fbb {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:36:40 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d6fe99-8676-4c65-b147-f0d0251abcbd]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:36:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b898dfaf-6509-4075-beb4-d0c70b7e1225 tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:40 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f Jul 08 02:36:40 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:41 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b898dfaf-6509-4075-beb4-d0c70b7e1225 tempest-SnapshotsActionsTest-1572096789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f" returned: 0 in 0.799s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-b898dfaf-6509-4075-beb4-d0c70b7e1225 tempest-SnapshotsActionsTest-1572096789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:36:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b898dfaf-6509-4075-beb4-d0c70b7e1225 tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:41 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46 1G Jul 08 02:36:41 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:42 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b898dfaf-6509-4075-beb4-d0c70b7e1225 tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46 1G" returned: 0 in 1.403s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b898dfaf-6509-4075-beb4-d0c70b7e1225 tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:42 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46 Jul 08 02:36:42 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:43 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b898dfaf-6509-4075-beb4-d0c70b7e1225 tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46" returned: 0 in 0.923s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:43 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-b898dfaf-6509-4075-beb4-d0c70b7e1225 tempest-SnapshotsActionsTest-1572096789 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46 is being set with open permissions: ugo+rw Jul 08 02:36:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b898dfaf-6509-4075-beb4-d0c70b7e1225 tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:43 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46 Jul 08 02:36:43 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:44 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b898dfaf-6509-4075-beb4-d0c70b7e1225 tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46" returned: 0 in 0.784s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b898dfaf-6509-4075-beb4-d0c70b7e1225 tempest-SnapshotsActionsTest-1572096789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:36:44 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b898dfaf-6509-4075-beb4-d0c70b7e1225 tempest-SnapshotsActionsTest-1572096789 None] Create snapshot completed successfully Jul 08 02:36:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Acquiring lock "cinder-6883dadc-a020-49f1-a448-9bd0fbc8fc46-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:36:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-6883dadc-a020-49f1-a448-9bd0fbc8fc46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:36:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Acquiring lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:36:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:36:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Acquiring lock "cinder-quobyte-6883dadc-a020-49f1-a448-9bd0fbc8fc46" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:36:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-quobyte-6883dadc-a020-49f1-a448-9bd0fbc8fc46" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:36:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Deleting offline snapshot 6883dadc-a020-49f1-a448-9bd0fbc8fc46 of volume dd8e67d7-ae59-4913-8189-cee8ffe81fbb {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:36:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] snapshot_file for this snap is: volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:36:45 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[78976948-79b4-4fd4-baa8-c924974811af]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:36:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:45 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46 Jul 08 02:36:45 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:45 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46" returned: 0 in 0.794s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:36:45 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb815c5-a0aa-4165-96f5-9bf2260acd46]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:36:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:46 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f Jul 08 02:36:46 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:46 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-be170d26-2760-4072-86ee-291da8424f35 req-79643583-d40f-43df-9601-5b3cc07f9305 tempest-AttachVolumeNegativeTest-1281536783 None] Terminate volume connection completed successfully. Jul 08 02:36:46 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-be170d26-2760-4072-86ee-291da8424f35 req-79643583-d40f-43df-9601-5b3cc07f9305 tempest-AttachVolumeNegativeTest-1281536783 None] Deleting attachment e0ad5804-8686-4f18-9602-50f68e32527e. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:36:46 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f" returned: 0 in 0.819s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:46 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:36:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:46 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46 Jul 08 02:36:46 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:36:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:36:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:36:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:36:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:36:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:36:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:47 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:36:47 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:47 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46" returned: 0 in 0.863s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:47 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46 Jul 08 02:36:47 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:48 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.810s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:36:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:36:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 8 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:36:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:36:48 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.6883dadc-a020-49f1-a448-9bd0fbc8fc46" returned: 0 in 0.854s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-quobyte-6883dadc-a020-49f1-a448-9bd0fbc8fc46" released by "_delete_snapshot" :: held 3.470s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:36:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" released by "delete_snapshot" :: held 3.502s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:36:48 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Created reservations ['0f25e926-0d75-48f4-b3ec-f794fa45da76', '0b99870b-78eb-41a3-b505-edb826d78c3f', '0b6980ed-9883-432f-93c3-a3be44078cc3', 'be2890e5-7db0-4875-8466-a8c6e7948994'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:36:48 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Delete snapshot completed successfully. Jul 08 02:36:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ed1be7e1-13fa-45d5-a1a7-4e4913bacfa7 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-6883dadc-a020-49f1-a448-9bd0fbc8fc46-delete_snapshot" released by "delete_snapshot" :: held 3.657s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:36:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e05d7763-3356-453b-a203-11e5650101b8 tempest-SnapshotsActionsTest-1572096789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:36:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e05d7763-3356-453b-a203-11e5650101b8 tempest-SnapshotsActionsTest-1572096789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:36:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-e05d7763-3356-453b-a203-11e5650101b8 tempest-SnapshotsActionsTest-1572096789 None] Creating offline snapshot 0781ca36-fced-415f-a393-4bb702967449 of volume dd8e67d7-ae59-4913-8189-cee8ffe81fbb {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:36:49 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ec0df3-1520-4fd2-bd2b-30a06e6c52bb]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:36:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e05d7763-3356-453b-a203-11e5650101b8 tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:49 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f Jul 08 02:36:49 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Acquiring lock "cinder-6413d7cd-596a-47e4-8aea-90b49cb9a564-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:36:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Lock "cinder-6413d7cd-596a-47e4-8aea-90b49cb9a564-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:36:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Acquiring lock "cinder-quobyte-6413d7cd-596a-47e4-8aea-90b49cb9a564" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:36:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Lock "cinder-quobyte-6413d7cd-596a-47e4-8aea-90b49cb9a564" acquired by "delete_volume" :: waited 0.039s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:36:50 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[be47ffb4-01ef-461f-bc5a-afe7c7c9cf76]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:36:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6413d7cd-596a-47e4-8aea-90b49cb9a564 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:50 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6413d7cd-596a-47e4-8aea-90b49cb9a564 Jul 08 02:36:50 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:51 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e05d7763-3356-453b-a203-11e5650101b8 tempest-SnapshotsActionsTest-1572096789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f" returned: 0 in 1.279s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-e05d7763-3356-453b-a203-11e5650101b8 tempest-SnapshotsActionsTest-1572096789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:36:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e05d7763-3356-453b-a203-11e5650101b8 tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:51 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449 1G Jul 08 02:36:51 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:51 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6413d7cd-596a-47e4-8aea-90b49cb9a564" returned: 0 in 1.076s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6413d7cd-596a-47e4-8aea-90b49cb9a564 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:51 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6413d7cd-596a-47e4-8aea-90b49cb9a564 Jul 08 02:36:51 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:52 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e05d7763-3356-453b-a203-11e5650101b8 tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449 1G" returned: 0 in 1.261s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e05d7763-3356-453b-a203-11e5650101b8 tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:52 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449 Jul 08 02:36:52 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:52 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6413d7cd-596a-47e4-8aea-90b49cb9a564" returned: 0 in 0.811s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Lock "cinder-quobyte-6413d7cd-596a-47e4-8aea-90b49cb9a564" released by "delete_volume" :: held 1.952s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:36:52 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Created reservations ['7062cc2f-f83b-4045-8cc6-e152f73b5233', 'dbdfbe2d-bf13-4b03-9b9f-f1770364da37', '54662c6b-47cb-41e8-b861-50f35ae51956', 'bd1a0ce0-bffe-436c-89e3-05145d3aeae5'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:36:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:36:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:36:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:36:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:36:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:36:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:52 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:36:52 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:53 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e05d7763-3356-453b-a203-11e5650101b8 tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449" returned: 0 in 0.893s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:53 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-e05d7763-3356-453b-a203-11e5650101b8 tempest-SnapshotsActionsTest-1572096789 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449 is being set with open permissions: ugo+rw Jul 08 02:36:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e05d7763-3356-453b-a203-11e5650101b8 tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:53 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449 Jul 08 02:36:53 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:53 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.817s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:53 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:36:53 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Deleted volume successfully. Jul 08 02:36:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b4f7fafe-bdc3-44ad-b93c-1f9e8a6901dc tempest-TaggedAttachmentsTest-2047410959 None] Lock "cinder-6413d7cd-596a-47e4-8aea-90b49cb9a564-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:36:54 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e05d7763-3356-453b-a203-11e5650101b8 tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449" returned: 0 in 0.802s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e05d7763-3356-453b-a203-11e5650101b8 tempest-SnapshotsActionsTest-1572096789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.370s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:36:54 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e05d7763-3356-453b-a203-11e5650101b8 tempest-SnapshotsActionsTest-1572096789 None] Create snapshot completed successfully Jul 08 02:36:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Acquiring lock "cinder-0781ca36-fced-415f-a393-4bb702967449-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:36:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-0781ca36-fced-415f-a393-4bb702967449-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:36:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Acquiring lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:36:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:36:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Acquiring lock "cinder-quobyte-0781ca36-fced-415f-a393-4bb702967449" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:36:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-quobyte-0781ca36-fced-415f-a393-4bb702967449" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:36:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Deleting offline snapshot 0781ca36-fced-415f-a393-4bb702967449 of volume dd8e67d7-ae59-4913-8189-cee8ffe81fbb {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:36:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] snapshot_file for this snap is: volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:36:55 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef8e0ff-6d66-47c4-bc92-90ddd68438f3]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:36:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:55 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449 Jul 08 02:36:55 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:56 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449" returned: 0 in 1.003s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:36:56 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eefb2e2-42a8-48cb-9441-91e468cb0e2c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:36:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:56 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f Jul 08 02:36:56 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:57 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f" returned: 0 in 0.958s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:57 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:36:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:57 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449 Jul 08 02:36:57 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:58 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449" returned: 0 in 0.986s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:36:58 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449 Jul 08 02:36:58 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:36:59 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Jul 08 02:36:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.0781ca36-fced-415f-a393-4bb702967449" returned: 0 in 0.748s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:36:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-quobyte-0781ca36-fced-415f-a393-4bb702967449" released by "_delete_snapshot" :: held 3.848s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:36:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" released by "delete_snapshot" :: held 3.877s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:36:59 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Created reservations ['4bacc6e3-e26a-4afd-af26-7220319e79f2', '0b9fee91-a6df-44be-8efb-2060300f8f2f', '4fdfd3db-b33c-4509-aad4-af260ef49925', '33e4e903-ac94-43ad-8ec7-5646df021f43'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:36:59 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Delete snapshot completed successfully. Jul 08 02:36:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c75bf47a-463d-4c78-a4ba-d295459f26e5 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-0781ca36-fced-415f-a393-4bb702967449-delete_snapshot" released by "delete_snapshot" :: held 4.030s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:36:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f6b29681-8f2e-4c64-85dc-0d8ae5b8cf23 tempest-SnapshotsActionsTest-1572096789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:36:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f6b29681-8f2e-4c64-85dc-0d8ae5b8cf23 tempest-SnapshotsActionsTest-1572096789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:36:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-f6b29681-8f2e-4c64-85dc-0d8ae5b8cf23 tempest-SnapshotsActionsTest-1572096789 None] Creating offline snapshot d2687379-4830-47ef-b8c8-784e24da459a of volume dd8e67d7-ae59-4913-8189-cee8ffe81fbb {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:36:59 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[51930ed0-2bd7-4f78-9d1a-039202d67d03]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:36:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f6b29681-8f2e-4c64-85dc-0d8ae5b8cf23 tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:00 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f Jul 08 02:37:00 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:00 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f6b29681-8f2e-4c64-85dc-0d8ae5b8cf23 tempest-SnapshotsActionsTest-1572096789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f" returned: 0 in 0.864s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-f6b29681-8f2e-4c64-85dc-0d8ae5b8cf23 tempest-SnapshotsActionsTest-1572096789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:37:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f6b29681-8f2e-4c64-85dc-0d8ae5b8cf23 tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:00 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a 1G Jul 08 02:37:00 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:01 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f6b29681-8f2e-4c64-85dc-0d8ae5b8cf23 tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a 1G" returned: 0 in 1.179s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f6b29681-8f2e-4c64-85dc-0d8ae5b8cf23 tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:02 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a Jul 08 02:37:02 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:02 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f6b29681-8f2e-4c64-85dc-0d8ae5b8cf23 tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a" returned: 0 in 0.942s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:02 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-f6b29681-8f2e-4c64-85dc-0d8ae5b8cf23 tempest-SnapshotsActionsTest-1572096789 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a is being set with open permissions: ugo+rw Jul 08 02:37:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f6b29681-8f2e-4c64-85dc-0d8ae5b8cf23 tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:02 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a Jul 08 02:37:02 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:03 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f6b29681-8f2e-4c64-85dc-0d8ae5b8cf23 tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a" returned: 0 in 0.860s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f6b29681-8f2e-4c64-85dc-0d8ae5b8cf23 tempest-SnapshotsActionsTest-1572096789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.003s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:37:03 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f6b29681-8f2e-4c64-85dc-0d8ae5b8cf23 tempest-SnapshotsActionsTest-1572096789 None] Create snapshot completed successfully Jul 08 02:37:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Acquiring lock "cinder-d2687379-4830-47ef-b8c8-784e24da459a-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:37:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-d2687379-4830-47ef-b8c8-784e24da459a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:37:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Acquiring lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:37:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:37:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Acquiring lock "cinder-quobyte-d2687379-4830-47ef-b8c8-784e24da459a" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:37:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-quobyte-d2687379-4830-47ef-b8c8-784e24da459a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:37:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Deleting offline snapshot d2687379-4830-47ef-b8c8-784e24da459a of volume dd8e67d7-ae59-4913-8189-cee8ffe81fbb {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:37:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] snapshot_file for this snap is: volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:37:04 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1855eb15-876e-4ccc-b0d6-6a8faa6c8232]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:37:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:04 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a Jul 08 02:37:04 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:05 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a" returned: 0 in 1.114s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:37:05 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf190ee-e3d9-4c22-b065-c7c7cbd4a3ee]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:37:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:05 devstack sudo[90046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f Jul 08 02:37:05 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:06 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f" returned: 0 in 0.853s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:37:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:06 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a Jul 08 02:37:06 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:07 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a" returned: 0 in 0.929s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:07 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a Jul 08 02:37:07 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:07 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.d2687379-4830-47ef-b8c8-784e24da459a" returned: 0 in 0.724s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-quobyte-d2687379-4830-47ef-b8c8-784e24da459a" released by "_delete_snapshot" :: held 3.766s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:37:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" released by "delete_snapshot" :: held 3.798s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:37:08 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Created reservations ['cac416de-4ae2-4d4a-8f76-54ba76a91efe', 'ee0ee6aa-b63d-4d08-ad97-d4c428b68010', 'e963e5a7-4a70-451b-a6c6-9e1c6a645ad9', 'f00ea590-365b-4774-8c15-2213542538a1'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:37:08 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Delete snapshot completed successfully. Jul 08 02:37:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ef493487-3176-4604-a7f2-ed9078ea7f07 tempest-SnapshotsActionsTest-1550897541 None] Lock "cinder-d2687379-4830-47ef-b8c8-784e24da459a-delete_snapshot" released by "delete_snapshot" :: held 3.993s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:37:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Acquiring lock "cinder-adab52b1-6fa9-4666-af9e-49041971b59f-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:37:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Lock "cinder-adab52b1-6fa9-4666-af9e-49041971b59f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:37:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Acquiring lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:37:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:37:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Acquiring lock "cinder-quobyte-adab52b1-6fa9-4666-af9e-49041971b59f" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:37:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Lock "cinder-quobyte-adab52b1-6fa9-4666-af9e-49041971b59f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:37:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Deleting offline snapshot adab52b1-6fa9-4666-af9e-49041971b59f of volume dd8e67d7-ae59-4913-8189-cee8ffe81fbb {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:37:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] snapshot_file for this snap is: volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:37:09 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[146e554c-888d-40c1-9621-4ca13000b3b2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:37:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:09 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f Jul 08 02:37:09 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:09 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f" returned: 0 in 0.863s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:37:09 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d84331-c125-4297-a486-35cb7c2ea343]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:37:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:10 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb Jul 08 02:37:10 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:11 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" returned: 0 in 1.109s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:11 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f Jul 08 02:37:11 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:11 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f" returned: 0 in 0.934s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:12 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f Jul 08 02:37:12 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:12 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb.adab52b1-6fa9-4666-af9e-49041971b59f" returned: 0 in 0.846s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:12 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=53,cinder:UPDATE=53,cinder:INSERT=14,cinder:DELETE=5 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:37:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Lock "cinder-quobyte-adab52b1-6fa9-4666-af9e-49041971b59f" released by "_delete_snapshot" :: held 3.890s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:37:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" released by "delete_snapshot" :: held 3.919s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:37:12 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Created reservations ['22b0b011-a3c1-45b6-9503-b9832d102346', '84bcc60e-c259-4f33-8ce1-eaf92b548f8b', '396feb56-9665-49e9-ac30-12555b659ee0', '0b1ecfae-2166-4d02-8453-31fc78820ac5'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:37:13 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Delete snapshot completed successfully. Jul 08 02:37:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-72526e92-8f4c-4365-b7f1-0c1d7851d13d tempest-SnapshotsActionsTest-1572096789 None] Lock "cinder-adab52b1-6fa9-4666-af9e-49041971b59f-delete_snapshot" released by "delete_snapshot" :: held 4.079s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:37:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Acquiring lock "cinder-dd8e67d7-ae59-4913-8189-cee8ffe81fbb-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:37:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Lock "cinder-dd8e67d7-ae59-4913-8189-cee8ffe81fbb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:37:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Acquiring lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:37:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" acquired by "delete_volume" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:37:13 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[349ff2db-aa90-4e00-81b8-a6284df6bf67]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:37:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:13 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb Jul 08 02:37:13 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:14 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" returned: 0 in 0.922s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:14 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb Jul 08 02:37:14 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:15 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" returned: 0 in 0.901s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Lock "cinder-quobyte-dd8e67d7-ae59-4913-8189-cee8ffe81fbb" released by "delete_volume" :: held 1.916s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:37:15 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Created reservations ['66b8c291-02b0-4cb7-855b-8c9cc25c0cd7', '96297894-3932-4889-aad8-aed98cb94413', '56dd52fc-15d1-4535-8319-0f3bd6f24441', '84c4dc31-b4c9-46f0-9463-935cb1b65af8'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:37:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:37:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:37:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:37:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:37:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:37:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:15 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:37:15 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:16 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.925s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:16 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:37:16 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Deleted volume successfully. Jul 08 02:37:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8217fbcf-0a90-41ec-95b2-e30eadad789e tempest-SnapshotsActionsTest-1572096789 None] Lock "cinder-dd8e67d7-ae59-4913-8189-cee8ffe81fbb-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:37:25 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=69,cinder:UPDATE=63,cinder:INSERT=15,cinder:DELETE=4 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:37:26 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=5,cinder:INSERT=6,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:37:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:37:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:37:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:37:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:37:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:37:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:37:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:47 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:37:47 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:48 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.598s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Flow 'volume_create_manager' (6abe6769-21ea-46a8-a76e-65c308cdd696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47b254e-e1b7-471e-b56a-2d01e0c59b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47b254e-e1b7-471e-b56a-2d01e0c59b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1457842092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fa526d-814e-4fe2-85b8-9c49f516070a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c573d1c1dc444379aeacda3d8946789a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:37:49Z,use_quota=True,user_id='0a63d4dc84fd402eaee6e7d300c42451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60997a11-287f-401d-946b-aebd0afcc3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60997a11-287f-401d-946b-aebd0afcc3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd855f5-4202-4307-8d63-f9b1204aa7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd855f5-4202-4307-8d63-f9b1204aa7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9fa526d-814e-4fe2-85b8-9c49f516070a', 'volume_name': 'volume-b9fa526d-814e-4fe2-85b8-9c49f516070a', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478b622a-711e-4f93-84cc-19f1993bb94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478b622a-711e-4f93-84cc-19f1993bb94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790361ef-c917-4784-b4ae-5acbc6af79ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:37:49 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Volume b9fa526d-814e-4fe2-85b8-9c49f516070a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9fa526d-814e-4fe2-85b8-9c49f516070a', 'volume_size': 1} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1457842092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fa526d-814e-4fe2-85b8-9c49f516070a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c573d1c1dc444379aeacda3d8946789a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:37:49Z,use_quota=True,user_id='0a63d4dc84fd402eaee6e7d300c42451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Creating volume b9fa526d-814e-4fe2-85b8-9c49f516070a {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:37:49 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:37:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b9fa526d-814e-4fe2-85b8-9c49f516070a 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:49 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b9fa526d-814e-4fe2-85b8-9c49f516070a 1073741824 Jul 08 02:37:49 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:50 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b9fa526d-814e-4fe2-85b8-9c49f516070a 1073741824" returned: 0 in 0.918s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b9fa526d-814e-4fe2-85b8-9c49f516070a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:50 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b9fa526d-814e-4fe2-85b8-9c49f516070a Jul 08 02:37:50 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:50 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b9fa526d-814e-4fe2-85b8-9c49f516070a" returned: 0 in 0.696s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:37:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:37:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790361ef-c917-4784-b4ae-5acbc6af79ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9fa526d-814e-4fe2-85b8-9c49f516070a', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:37:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a16e37-1eaf-42c8-8d8f-40559672a755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:37:51 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Volume volume-b9fa526d-814e-4fe2-85b8-9c49f516070a (b9fa526d-814e-4fe2-85b8-9c49f516070a): created successfully Jul 08 02:37:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a16e37-1eaf-42c8-8d8f-40559672a755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:37:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Flow 'volume_create_manager' (6abe6769-21ea-46a8-a76e-65c308cdd696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:37:51 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-1b2684da-d4ed-4dba-ab22-f20263efb9d5 tempest-VolumesServicesTestJSON-368188427 None] Created volume successfully. Jul 08 02:37:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Acquiring lock "cinder-b9fa526d-814e-4fe2-85b8-9c49f516070a-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:37:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Lock "cinder-b9fa526d-814e-4fe2-85b8-9c49f516070a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:37:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Acquiring lock "cinder-quobyte-b9fa526d-814e-4fe2-85b8-9c49f516070a" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:37:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Lock "cinder-quobyte-b9fa526d-814e-4fe2-85b8-9c49f516070a" acquired by "delete_volume" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:37:51 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9813af-a497-4b37-9508-53e06a33ac3a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:37:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b9fa526d-814e-4fe2-85b8-9c49f516070a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:51 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b9fa526d-814e-4fe2-85b8-9c49f516070a Jul 08 02:37:51 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:52 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b9fa526d-814e-4fe2-85b8-9c49f516070a" returned: 0 in 0.817s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b9fa526d-814e-4fe2-85b8-9c49f516070a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:52 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b9fa526d-814e-4fe2-85b8-9c49f516070a Jul 08 02:37:52 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:53 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b9fa526d-814e-4fe2-85b8-9c49f516070a" returned: 0 in 0.754s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Lock "cinder-quobyte-b9fa526d-814e-4fe2-85b8-9c49f516070a" released by "delete_volume" :: held 1.624s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:37:53 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Created reservations ['f2fc9144-1031-4d0c-b326-486953206841', '00eca138-ac8f-44b6-a0fa-acaac132e154', '612b671a-1e48-473e-ba28-36a9143f3d88', '734c956d-c38f-4c56-848f-d26ede11f327'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:37:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:37:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:37:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:37:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:37:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:37:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:37:53 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:37:53 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:37:54 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Jul 08 02:37:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.668s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:37:54 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:37:54 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Deleted volume successfully. Jul 08 02:37:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a5660409-c6ae-4bc9-a795-13a485760c1a tempest-VolumesServicesTestJSON-368188427 None] Lock "cinder-b9fa526d-814e-4fe2-85b8-9c49f516070a-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Flow 'volume_create_manager' (8043b048-3c36-4229-8c58-413883de8d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098fa099-04e7-4532-ab36-e67166198aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098fa099-04e7-4532-ab36-e67166198aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2122549445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d88d84b-e300-4eba-8e46-1098f2880477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3b5b45f19243378e7a6c9d093f8619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:38:02Z,use_quota=True,user_id='6ad98c44483d466aab7821c2b75da0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee942151-bd5f-440d-8dec-fe0fea9eac1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee942151-bd5f-440d-8dec-fe0fea9eac1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b9b9d4-e227-487a-bd44-589f7ffeb427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b9b9d4-e227-487a-bd44-589f7ffeb427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d88d84b-e300-4eba-8e46-1098f2880477', 'volume_name': 'volume-0d88d84b-e300-4eba-8e46-1098f2880477', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f05b3e3-a48d-4415-a923-ff93bf886c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f05b3e3-a48d-4415-a923-ff93bf886c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7035f1d3-79eb-4fe0-a519-430f809ae327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:01 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Volume 0d88d84b-e300-4eba-8e46-1098f2880477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d88d84b-e300-4eba-8e46-1098f2880477', 'volume_size': 1} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2122549445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d88d84b-e300-4eba-8e46-1098f2880477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3b5b45f19243378e7a6c9d093f8619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:38:02Z,use_quota=True,user_id='6ad98c44483d466aab7821c2b75da0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Creating volume 0d88d84b-e300-4eba-8e46-1098f2880477 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:38:01 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:38:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0d88d84b-e300-4eba-8e46-1098f2880477 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:38:01 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0d88d84b-e300-4eba-8e46-1098f2880477 1073741824 Jul 08 02:38:01 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:38:02 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Jul 08 02:38:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0d88d84b-e300-4eba-8e46-1098f2880477 1073741824" returned: 0 in 0.908s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:38:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0d88d84b-e300-4eba-8e46-1098f2880477 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:38:02 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0d88d84b-e300-4eba-8e46-1098f2880477 Jul 08 02:38:02 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:38:03 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Jul 08 02:38:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0d88d84b-e300-4eba-8e46-1098f2880477" returned: 0 in 0.737s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:38:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:38:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:38:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7035f1d3-79eb-4fe0-a519-430f809ae327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d88d84b-e300-4eba-8e46-1098f2880477', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd3238d-de50-4853-8385-66ae4d086c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:03 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Volume volume-0d88d84b-e300-4eba-8e46-1098f2880477 (0d88d84b-e300-4eba-8e46-1098f2880477): created successfully Jul 08 02:38:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd3238d-de50-4853-8385-66ae4d086c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Flow 'volume_create_manager' (8043b048-3c36-4229-8c58-413883de8d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:38:03 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3d218827-c8d8-43a0-9762-78f8f1e2b0d8 tempest-AttachVolumeNegativeTest-1281536783 None] Created volume successfully. Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Flow 'volume_create_manager' (307861b7-48c5-488c-9be8-fb68239697fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73dc656-199c-40ce-92e4-4029c702ea3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73dc656-199c-40ce-92e4-4029c702ea3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1874640946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429da162-7f2e-43ad-8e44-b9bf4fc3de6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9e9e85e668d4a58b83b4435b5e182b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:38:06Z,use_quota=True,user_id='d1e5af0af79e45699b526152549d9deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a23c2b-62fd-4f5e-9d5f-a55a22107ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a23c2b-62fd-4f5e-9d5f-a55a22107ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93f431d-0bff-40da-9417-b03e30ff5e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93f431d-0bff-40da-9417-b03e30ff5e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429da162-7f2e-43ad-8e44-b9bf4fc3de6b', 'volume_name': 'volume-429da162-7f2e-43ad-8e44-b9bf4fc3de6b', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb324e8d-91a0-405d-894d-8c64eb66120c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb324e8d-91a0-405d-894d-8c64eb66120c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0088a7-303b-408c-bd9f-1aeb26e48ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:06 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Volume 429da162-7f2e-43ad-8e44-b9bf4fc3de6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429da162-7f2e-43ad-8e44-b9bf4fc3de6b', 'volume_size': 1} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1874640946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429da162-7f2e-43ad-8e44-b9bf4fc3de6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9e9e85e668d4a58b83b4435b5e182b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:38:06Z,use_quota=True,user_id='d1e5af0af79e45699b526152549d9deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Creating volume 429da162-7f2e-43ad-8e44-b9bf4fc3de6b {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:38:06 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-429da162-7f2e-43ad-8e44-b9bf4fc3de6b 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:38:06 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-429da162-7f2e-43ad-8e44-b9bf4fc3de6b 1073741824 Jul 08 02:38:06 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:38:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-b842939e-4dff-41ef-af67-2dce3abff041 req-8df43d53-7a47-4d3c-a362-2ab1e285358b tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:38:07 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Jul 08 02:38:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-429da162-7f2e-43ad-8e44-b9bf4fc3de6b 1073741824" returned: 0 in 1.090s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:38:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-429da162-7f2e-43ad-8e44-b9bf4fc3de6b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:38:07 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-429da162-7f2e-43ad-8e44-b9bf4fc3de6b Jul 08 02:38:07 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:38:08 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Jul 08 02:38:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-429da162-7f2e-43ad-8e44-b9bf4fc3de6b" returned: 0 in 0.793s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:38:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:38:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:38:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-b842939e-4dff-41ef-af67-2dce3abff041 req-8df43d53-7a47-4d3c-a362-2ab1e285358b tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.112s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:38:08 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e0b634-9f87-433f-92bd-35114159aa60]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:38:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-b842939e-4dff-41ef-af67-2dce3abff041 req-8df43d53-7a47-4d3c-a362-2ab1e285358b tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0d88d84b-e300-4eba-8e46-1098f2880477 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:38:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0088a7-303b-408c-bd9f-1aeb26e48ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429da162-7f2e-43ad-8e44-b9bf4fc3de6b', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0a3b3b-9829-4b43-bc31-a233895a2177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:08 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Volume volume-429da162-7f2e-43ad-8e44-b9bf4fc3de6b (429da162-7f2e-43ad-8e44-b9bf4fc3de6b): created successfully Jul 08 02:38:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0a3b3b-9829-4b43-bc31-a233895a2177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Flow 'volume_create_manager' (307861b7-48c5-488c-9be8-fb68239697fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:38:08 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-85c34f1a-45e9-434a-b0b9-dbdd515bdec4 tempest-AttachVolumeShelveTestJSON-1344777832 None] Created volume successfully. Jul 08 02:38:08 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0d88d84b-e300-4eba-8e46-1098f2880477 Jul 08 02:38:08 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:38:08 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Jul 08 02:38:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-b842939e-4dff-41ef-af67-2dce3abff041 req-8df43d53-7a47-4d3c-a362-2ab1e285358b tempest-AttachVolumeNegativeTest-1281536783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0d88d84b-e300-4eba-8e46-1098f2880477" returned: 0 in 0.825s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:38:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-b842939e-4dff-41ef-af67-2dce3abff041 req-8df43d53-7a47-4d3c-a362-2ab1e285358b tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.841s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:38:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-b842939e-4dff-41ef-af67-2dce3abff041 req-8df43d53-7a47-4d3c-a362-2ab1e285358b tempest-AttachVolumeNegativeTest-1281536783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-0d88d84b-e300-4eba-8e46-1098f2880477', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '645edc91-8f4b-42b5-a79e-e595213b3c16', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:38:09 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-b842939e-4dff-41ef-af67-2dce3abff041 req-8df43d53-7a47-4d3c-a362-2ab1e285358b tempest-AttachVolumeNegativeTest-1281536783 None] attachment_update completed successfully. Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Flow 'volume_create_manager' (d774aee5-b10f-48d5-ad7c-1d13ee67f4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd5069d-d473-4d9d-830a-c53c38f4258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd5069d-d473-4d9d-830a-c53c38f4258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-34356724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b90c5dd-1f0f-4aec-882d-7eaa782b9875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5fde98bcf134d09bc0d2a2380b61b0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:38:10Z,use_quota=True,user_id='d70bac2d064d4d02afcc1ed0cc43c4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad4231e-7ea4-4bde-bb29-da445914b1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad4231e-7ea4-4bde-bb29-da445914b1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dbc0624-cdf8-4523-866f-c16cf8b04ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dbc0624-cdf8-4523-866f-c16cf8b04ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b90c5dd-1f0f-4aec-882d-7eaa782b9875', 'volume_name': 'volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1d6fc1-82c8-4095-b737-acebee6dd7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1d6fc1-82c8-4095-b737-acebee6dd7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d29531-af9a-4280-8594-4b3ff372b0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:10 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Volume 8b90c5dd-1f0f-4aec-882d-7eaa782b9875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875', 'volume_size': 1} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-34356724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b90c5dd-1f0f-4aec-882d-7eaa782b9875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5fde98bcf134d09bc0d2a2380b61b0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:38:10Z,use_quota=True,user_id='d70bac2d064d4d02afcc1ed0cc43c4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Creating volume 8b90c5dd-1f0f-4aec-882d-7eaa782b9875 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:38:10 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:38:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:38:10 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875 1073741824 Jul 08 02:38:10 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:38:11 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Jul 08 02:38:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875 1073741824" returned: 0 in 1.103s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:38:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:38:11 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875 Jul 08 02:38:11 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:38:12 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Jul 08 02:38:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875" returned: 0 in 0.719s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:38:12 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:38:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:38:12 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d29531-af9a-4280-8594-4b3ff372b0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:12 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28835ac2-65bf-4594-98e7-c5493204c4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:12 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Volume volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875 (8b90c5dd-1f0f-4aec-882d-7eaa782b9875): created successfully Jul 08 02:38:12 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28835ac2-65bf-4594-98e7-c5493204c4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:12 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Flow 'volume_create_manager' (d774aee5-b10f-48d5-ad7c-1d13ee67f4ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:38:12 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3c21a358-1c6e-4f20-84b8-f2509e7d680d tempest-ServerActionsTestOtherA-1294969195 None] Created volume successfully. Jul 08 02:38:16 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-ac1c9219-da45-4c31-a77b-b80a37c498bf req-77a4ad30-c417-464d-a7b3-816044c30c52 tempest-AttachVolumeNegativeTest-1281536783 None] Terminate volume connection completed successfully. Jul 08 02:38:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-ac1c9219-da45-4c31-a77b-b80a37c498bf req-77a4ad30-c417-464d-a7b3-816044c30c52 tempest-AttachVolumeNegativeTest-1281536783 None] Deleting attachment 645edc91-8f4b-42b5-a79e-e595213b3c16. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:38:22 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=22,cinder:SELECT=19,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:38:26 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=21,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:38:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-e2943246-8218-4488-b087-672fcfba519f req-8ae572a4-eb5b-4aa0-b803-ee877246922c tempest-AttachVolumeShelveTestJSON-1344777832 None] No connector for attachment ea029fb8-fa0b-4c20-b419-c15cf02f423b; skipping storage backend terminate_connection call. {{(pid=87238) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 08 02:38:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-e2943246-8218-4488-b087-672fcfba519f req-8ae572a4-eb5b-4aa0-b803-ee877246922c tempest-AttachVolumeShelveTestJSON-1344777832 None] Deleting attachment ea029fb8-fa0b-4c20-b419-c15cf02f423b. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:38:41 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=2 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:38:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:38:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:38:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:38:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:38:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:38:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:38:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:38:47 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:38:47 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:38:48 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Jul 08 02:38:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.935s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:38:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:38:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:38:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 8 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:38:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Flow 'volume_create_manager' (a66db7cb-1ed7-40ed-aefc-f07d075150fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37f1e39-63e7-4605-835f-e2e261852789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37f1e39-63e7-4605-835f-e2e261852789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-832671263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bb74d74-6fce-48ac-b84d-97a5b247c988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3e4f75f252484ea1e9f9ecc7009916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:38:49Z,use_quota=True,user_id='a8d6853714c04b56955f3b24123c3571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c867b1f2-eb96-495f-a8cc-a2d88c9babce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c867b1f2-eb96-495f-a8cc-a2d88c9babce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34181b83-22a1-4945-92d2-eb8f3655a286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34181b83-22a1-4945-92d2-eb8f3655a286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bb74d74-6fce-48ac-b84d-97a5b247c988', 'volume_name': 'volume-7bb74d74-6fce-48ac-b84d-97a5b247c988', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b407726-79c6-48e3-ad2f-66fe966095d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b407726-79c6-48e3-ad2f-66fe966095d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d4dd47-d403-4d62-951d-9c53f1571cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:49 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Volume 7bb74d74-6fce-48ac-b84d-97a5b247c988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bb74d74-6fce-48ac-b84d-97a5b247c988', 'volume_size': 1} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-832671263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bb74d74-6fce-48ac-b84d-97a5b247c988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3e4f75f252484ea1e9f9ecc7009916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:38:49Z,use_quota=True,user_id='a8d6853714c04b56955f3b24123c3571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Creating volume 7bb74d74-6fce-48ac-b84d-97a5b247c988 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:38:49 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:38:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bb74d74-6fce-48ac-b84d-97a5b247c988 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:38:49 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bb74d74-6fce-48ac-b84d-97a5b247c988 1073741824 Jul 08 02:38:49 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:38:50 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Jul 08 02:38:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bb74d74-6fce-48ac-b84d-97a5b247c988 1073741824" returned: 0 in 1.516s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:38:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bb74d74-6fce-48ac-b84d-97a5b247c988 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:38:50 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bb74d74-6fce-48ac-b84d-97a5b247c988 Jul 08 02:38:50 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:38:52 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Jul 08 02:38:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bb74d74-6fce-48ac-b84d-97a5b247c988" returned: 0 in 1.504s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:38:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] <== create_volume: return (3092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:38:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.099s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:38:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d4dd47-d403-4d62-951d-9c53f1571cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bb74d74-6fce-48ac-b84d-97a5b247c988', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01906ca3-4f15-4fa0-bf44-5804f696ee71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:38:52 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Volume volume-7bb74d74-6fce-48ac-b84d-97a5b247c988 (7bb74d74-6fce-48ac-b84d-97a5b247c988): created successfully Jul 08 02:38:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01906ca3-4f15-4fa0-bf44-5804f696ee71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:38:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Flow 'volume_create_manager' (a66db7cb-1ed7-40ed-aefc-f07d075150fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:38:52 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-146fe54d-596b-49a9-9d73-3c03306c25b2 tempest-VolumesActionsTest-999607813 None] Created volume successfully. Jul 08 02:38:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6ec725ce-5a9a-4e26-9b6b-0234ffbdb7d4 tempest-VolumesActionsTest-999607813 None] Acquiring lock "cinder-7bb74d74-6fce-48ac-b84d-97a5b247c988" by "attach_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:38:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6ec725ce-5a9a-4e26-9b6b-0234ffbdb7d4 tempest-VolumesActionsTest-999607813 None] Lock "cinder-7bb74d74-6fce-48ac-b84d-97a5b247c988" acquired by "attach_volume" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:38:53 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-6ec725ce-5a9a-4e26-9b6b-0234ffbdb7d4 tempest-VolumesActionsTest-999607813 None] Attaching volume 7bb74d74-6fce-48ac-b84d-97a5b247c988 to instance 9a3c2ce7-809b-4906-b4f1-a7afcab7e287 at mountpoint /dev/vdb on host None. Jul 08 02:38:54 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-6ec725ce-5a9a-4e26-9b6b-0234ffbdb7d4 tempest-VolumesActionsTest-999607813 None] Attach volume completed successfully. Jul 08 02:38:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6ec725ce-5a9a-4e26-9b6b-0234ffbdb7d4 tempest-VolumesActionsTest-999607813 None] Lock "cinder-7bb74d74-6fce-48ac-b84d-97a5b247c988" released by "attach_volume" :: held 0.283s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:38:55 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-763315b6-a9db-4b2e-b7ee-3eda16399105 tempest-VolumesActionsTest-106032596 None] Terminate volume connection completed successfully. Jul 08 02:38:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-763315b6-a9db-4b2e-b7ee-3eda16399105 tempest-VolumesActionsTest-106032596 None] Acquiring lock "cinder-7bb74d74-6fce-48ac-b84d-97a5b247c988-detach_volume" by "detach_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:38:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-763315b6-a9db-4b2e-b7ee-3eda16399105 tempest-VolumesActionsTest-106032596 None] Lock "cinder-7bb74d74-6fce-48ac-b84d-97a5b247c988-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:38:56 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-763315b6-a9db-4b2e-b7ee-3eda16399105 tempest-VolumesActionsTest-106032596 None] Detaching volume 7bb74d74-6fce-48ac-b84d-97a5b247c988 from instance 9a3c2ce7-809b-4906-b4f1-a7afcab7e287. Jul 08 02:38:56 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-763315b6-a9db-4b2e-b7ee-3eda16399105 tempest-VolumesActionsTest-106032596 None] Detach volume completed successfully. Jul 08 02:38:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-763315b6-a9db-4b2e-b7ee-3eda16399105 tempest-VolumesActionsTest-106032596 None] Lock "cinder-7bb74d74-6fce-48ac-b84d-97a5b247c988-detach_volume" released by "detach_volume" :: held 0.144s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:38:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8bde0df7-2006-49b2-8226-d5abdb9d67cd tempest-VolumesActionsTest-999607813 None] Acquiring lock "cinder-7bb74d74-6fce-48ac-b84d-97a5b247c988-detach_volume" by "detach_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:38:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8bde0df7-2006-49b2-8226-d5abdb9d67cd tempest-VolumesActionsTest-999607813 None] Lock "cinder-7bb74d74-6fce-48ac-b84d-97a5b247c988-detach_volume" acquired by "detach_volume" :: waited 0.070s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:38:57 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-8bde0df7-2006-49b2-8226-d5abdb9d67cd tempest-VolumesActionsTest-999607813 None] Volume detach called, but volume not attached. Jul 08 02:38:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8bde0df7-2006-49b2-8226-d5abdb9d67cd tempest-VolumesActionsTest-999607813 None] Lock "cinder-7bb74d74-6fce-48ac-b84d-97a5b247c988-detach_volume" released by "detach_volume" :: held 0.052s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:38:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Acquiring lock "cinder-7bb74d74-6fce-48ac-b84d-97a5b247c988-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:38:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Lock "cinder-7bb74d74-6fce-48ac-b84d-97a5b247c988-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:38:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Acquiring lock "cinder-quobyte-7bb74d74-6fce-48ac-b84d-97a5b247c988" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:38:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Lock "cinder-quobyte-7bb74d74-6fce-48ac-b84d-97a5b247c988" acquired by "delete_volume" :: waited 0.032s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:38:58 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb7220a-514a-4ee7-b5d5-7c9f4a4a67f0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:38:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bb74d74-6fce-48ac-b84d-97a5b247c988 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:38:58 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bb74d74-6fce-48ac-b84d-97a5b247c988 Jul 08 02:38:58 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:00 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bb74d74-6fce-48ac-b84d-97a5b247c988" returned: 0 in 1.531s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bb74d74-6fce-48ac-b84d-97a5b247c988 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:00 devstack sudo[91545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bb74d74-6fce-48ac-b84d-97a5b247c988 Jul 08 02:39:00 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:01 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bb74d74-6fce-48ac-b84d-97a5b247c988" returned: 0 in 1.039s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:01 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Lock "cinder-quobyte-7bb74d74-6fce-48ac-b84d-97a5b247c988" released by "delete_volume" :: held 2.662s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:01 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Created reservations ['040e4ad4-ce6a-45fb-8807-f470a50a55e2', 'a761b1bb-0538-4de8-9961-4113df9b03ec', '6103b367-3fca-4ba7-a4ab-87cc568be565', '4f370f7f-f358-4f7f-942a-97f3b29f0821'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:39:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:01 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:39:01 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:02 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.858s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:02 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:39:02 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Deleted volume successfully. Jul 08 02:39:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-63f36da4-aaa9-4e01-ad96-b974197fc9ff tempest-VolumesActionsTest-999607813 None] Lock "cinder-7bb74d74-6fce-48ac-b84d-97a5b247c988-delete_volume" released by "delete_volume" :: held 3.878s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-71f661a4-728e-480c-9bac-17c4a17866b7 req-81ae7409-ec15-4d8a-826d-73dc5c4684dc tempest-ServerActionsTestOtherA-1294969195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-71f661a4-728e-480c-9bac-17c4a17866b7 req-81ae7409-ec15-4d8a-826d-73dc5c4684dc tempest-ServerActionsTestOtherA-1294969195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:03 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef46da55-65a6-4d86-af30-27b62134751c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:39:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-71f661a4-728e-480c-9bac-17c4a17866b7 req-81ae7409-ec15-4d8a-826d-73dc5c4684dc tempest-ServerActionsTestOtherA-1294969195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:03 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875 Jul 08 02:39:03 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:04 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-71f661a4-728e-480c-9bac-17c4a17866b7 req-81ae7409-ec15-4d8a-826d-73dc5c4684dc tempest-ServerActionsTestOtherA-1294969195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875" returned: 0 in 1.036s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-71f661a4-728e-480c-9bac-17c4a17866b7 req-81ae7409-ec15-4d8a-826d-73dc5c4684dc tempest-ServerActionsTestOtherA-1294969195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.067s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-71f661a4-728e-480c-9bac-17c4a17866b7 req-81ae7409-ec15-4d8a-826d-73dc5c4684dc tempest-ServerActionsTestOtherA-1294969195 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'faf32fb1-32cb-431f-8561-c7a6fc474cf8', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:39:04 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-71f661a4-728e-480c-9bac-17c4a17866b7 req-81ae7409-ec15-4d8a-826d-73dc5c4684dc tempest-ServerActionsTestOtherA-1294969195 None] attachment_update completed successfully. Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Flow 'volume_create_manager' (4e02910b-5b43-416a-a5af-9ab8b04801fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1d4d76-6425-43d0-8809-e34fc360e740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1d4d76-6425-43d0-8809-e34fc360e740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2030525732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a7ca0a-6336-41e3-a767-1e41890ee73d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3e4f75f252484ea1e9f9ecc7009916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:39:11Z,use_quota=True,user_id='a8d6853714c04b56955f3b24123c3571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c34445a-79a3-4b91-8351-af25b3436715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c34445a-79a3-4b91-8351-af25b3436715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3891b0-c756-474b-b8cb-494aa961df1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3891b0-c756-474b-b8cb-494aa961df1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5a7ca0a-6336-41e3-a767-1e41890ee73d', 'volume_name': 'volume-f5a7ca0a-6336-41e3-a767-1e41890ee73d', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ee4323-dd72-4d6f-b24c-b465c4ebe78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ee4323-dd72-4d6f-b24c-b465c4ebe78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7478d1be-a7b9-4637-aaeb-9e0f5e754d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:11 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Volume f5a7ca0a-6336-41e3-a767-1e41890ee73d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5a7ca0a-6336-41e3-a767-1e41890ee73d', 'volume_size': 1} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2030525732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a7ca0a-6336-41e3-a767-1e41890ee73d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3e4f75f252484ea1e9f9ecc7009916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:39:11Z,use_quota=True,user_id='a8d6853714c04b56955f3b24123c3571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Creating volume f5a7ca0a-6336-41e3-a767-1e41890ee73d {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:39:11 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:39:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f5a7ca0a-6336-41e3-a767-1e41890ee73d 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:11 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f5a7ca0a-6336-41e3-a767-1e41890ee73d 1073741824 Jul 08 02:39:11 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:12 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f5a7ca0a-6336-41e3-a767-1e41890ee73d 1073741824" returned: 0 in 0.809s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f5a7ca0a-6336-41e3-a767-1e41890ee73d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:12 devstack sudo[92068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f5a7ca0a-6336-41e3-a767-1e41890ee73d Jul 08 02:39:12 devstack sudo[92068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:12 devstack sudo[92068]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f5a7ca0a-6336-41e3-a767-1e41890ee73d" returned: 0 in 0.638s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:12 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:39:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:12 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7478d1be-a7b9-4637-aaeb-9e0f5e754d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5a7ca0a-6336-41e3-a767-1e41890ee73d', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:12 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2247dea0-da7c-4489-b97f-3f124092af70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:12 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Volume volume-f5a7ca0a-6336-41e3-a767-1e41890ee73d (f5a7ca0a-6336-41e3-a767-1e41890ee73d): created successfully Jul 08 02:39:12 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2247dea0-da7c-4489-b97f-3f124092af70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:12 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Flow 'volume_create_manager' (4e02910b-5b43-416a-a5af-9ab8b04801fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:39:12 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-6f5a92c3-9387-4cce-913e-247880aecbfe tempest-VolumesActionsTest-999607813 None] Created volume successfully. Jul 08 02:39:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Acquiring lock "cinder-f5a7ca0a-6336-41e3-a767-1e41890ee73d-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:13 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-d948f4ab-bb4c-49c2-89b8-920d6f0ada14 req-ad7584b9-cbca-4775-8133-a69a10ba7b19 tempest-ServerActionsTestOtherA-1294969195 None] Terminate volume connection completed successfully. Jul 08 02:39:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-d948f4ab-bb4c-49c2-89b8-920d6f0ada14 req-ad7584b9-cbca-4775-8133-a69a10ba7b19 tempest-ServerActionsTestOtherA-1294969195 None] Deleting attachment faf32fb1-32cb-431f-8561-c7a6fc474cf8. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:39:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Lock "cinder-f5a7ca0a-6336-41e3-a767-1e41890ee73d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Acquiring lock "cinder-quobyte-f5a7ca0a-6336-41e3-a767-1e41890ee73d" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Lock "cinder-quobyte-f5a7ca0a-6336-41e3-a767-1e41890ee73d" acquired by "delete_volume" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:13 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e920ad-1d88-45f2-b235-286e9ba8f191]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:39:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f5a7ca0a-6336-41e3-a767-1e41890ee73d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:13 devstack sudo[92103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f5a7ca0a-6336-41e3-a767-1e41890ee73d Jul 08 02:39:13 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:14 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f5a7ca0a-6336-41e3-a767-1e41890ee73d" returned: 0 in 0.773s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f5a7ca0a-6336-41e3-a767-1e41890ee73d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:14 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f5a7ca0a-6336-41e3-a767-1e41890ee73d Jul 08 02:39:14 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:15 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f5a7ca0a-6336-41e3-a767-1e41890ee73d" returned: 0 in 0.810s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Lock "cinder-quobyte-f5a7ca0a-6336-41e3-a767-1e41890ee73d" released by "delete_volume" :: held 1.627s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:15 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Created reservations ['89da2e76-1066-4b37-ad76-fefd9619e096', 'dff76196-8507-4f0b-bbde-08952f4124fc', 'e2d71577-a0bb-4533-9d21-c15a11f0a93f', 'c90457ba-0dc5-4573-b67f-6335c95ab109'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:39:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:15 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:39:15 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-d948f4ab-bb4c-49c2-89b8-920d6f0ada14 req-4f5fcbf7-7034-42a5-809d-dc7b242801ba tempest-ServerActionsTestOtherA-1294969195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-d948f4ab-bb4c-49c2-89b8-920d6f0ada14 req-4f5fcbf7-7034-42a5-809d-dc7b242801ba tempest-ServerActionsTestOtherA-1294969195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[830a737c-0576-4458-af15-a6a3e94a1808]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-d948f4ab-bb4c-49c2-89b8-920d6f0ada14 req-4f5fcbf7-7034-42a5-809d-dc7b242801ba tempest-ServerActionsTestOtherA-1294969195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:16 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.684s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:39:16 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Deleted volume successfully. Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1ad54d1c-49b8-4828-a9ba-f102e9ad6de5 tempest-VolumesActionsTest-106032596 None] Lock "cinder-f5a7ca0a-6336-41e3-a767-1e41890ee73d-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:16 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875 Jul 08 02:39:16 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Flow 'volume_create_manager' (175dd6fc-5afa-4511-9c1f-f62a0c48fdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71efcb74-3b7a-427b-ba64-a980b4497284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71efcb74-3b7a-427b-ba64-a980b4497284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1688390774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7dd9b3-fbf8-4109-8a76-ac57f167334d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3e4f75f252484ea1e9f9ecc7009916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:39:16Z,use_quota=True,user_id='a8d6853714c04b56955f3b24123c3571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb4176d-7eb2-4381-89c3-f3ed8d2b6bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb4176d-7eb2-4381-89c3-f3ed8d2b6bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9866b0-afc9-4904-af38-8ad39c19ba5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9866b0-afc9-4904-af38-8ad39c19ba5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b7dd9b3-fbf8-4109-8a76-ac57f167334d', 'volume_name': 'volume-7b7dd9b3-fbf8-4109-8a76-ac57f167334d', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee500fc0-607d-4d73-be1f-45d0d0793fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee500fc0-607d-4d73-be1f-45d0d0793fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258c0d58-bcaa-401e-b828-78a6e2f7d96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:16 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Volume 7b7dd9b3-fbf8-4109-8a76-ac57f167334d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b7dd9b3-fbf8-4109-8a76-ac57f167334d', 'volume_size': 1} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:16 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-d948f4ab-bb4c-49c2-89b8-920d6f0ada14 req-4f5fcbf7-7034-42a5-809d-dc7b242801ba tempest-ServerActionsTestOtherA-1294969195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875" returned: 0 in 0.826s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-d948f4ab-bb4c-49c2-89b8-920d6f0ada14 req-4f5fcbf7-7034-42a5-809d-dc7b242801ba tempest-ServerActionsTestOtherA-1294969195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.845s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1688390774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7dd9b3-fbf8-4109-8a76-ac57f167334d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3e4f75f252484ea1e9f9ecc7009916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:39:16Z,use_quota=True,user_id='a8d6853714c04b56955f3b24123c3571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Creating volume 7b7dd9b3-fbf8-4109-8a76-ac57f167334d {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:39:16 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b7dd9b3-fbf8-4109-8a76-ac57f167334d 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:16 devstack sudo[92154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b7dd9b3-fbf8-4109-8a76-ac57f167334d 1073741824 Jul 08 02:39:16 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-d948f4ab-bb4c-49c2-89b8-920d6f0ada14 req-4f5fcbf7-7034-42a5-809d-dc7b242801ba tempest-ServerActionsTestOtherA-1294969195 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b8ba460-9398-45ca-8afa-154cf93da103', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:39:16 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-d948f4ab-bb4c-49c2-89b8-920d6f0ada14 req-4f5fcbf7-7034-42a5-809d-dc7b242801ba tempest-ServerActionsTestOtherA-1294969195 None] attachment_update completed successfully. Jul 08 02:39:17 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b7dd9b3-fbf8-4109-8a76-ac57f167334d 1073741824" returned: 0 in 0.965s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b7dd9b3-fbf8-4109-8a76-ac57f167334d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:17 devstack sudo[92193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b7dd9b3-fbf8-4109-8a76-ac57f167334d Jul 08 02:39:17 devstack sudo[92193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:18 devstack sudo[92193]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b7dd9b3-fbf8-4109-8a76-ac57f167334d" returned: 0 in 0.680s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:39:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258c0d58-bcaa-401e-b828-78a6e2f7d96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b7dd9b3-fbf8-4109-8a76-ac57f167334d', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7eb91b-110d-4827-bf3c-970d6f821852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:18 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Volume volume-7b7dd9b3-fbf8-4109-8a76-ac57f167334d (7b7dd9b3-fbf8-4109-8a76-ac57f167334d): created successfully Jul 08 02:39:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7eb91b-110d-4827-bf3c-970d6f821852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Flow 'volume_create_manager' (175dd6fc-5afa-4511-9c1f-f62a0c48fdc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:39:18 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-d56d1c9c-8b87-44ac-95c7-843cfeeb7613 tempest-VolumesActionsTest-999607813 None] Created volume successfully. Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Flow 'volume_create_manager' (838b5976-4305-4a37-aa1c-6101107fe3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921074a7-f03c-4d12-99d6-a5573edf4ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921074a7-f03c-4d12-99d6-a5573edf4ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1047785169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303e358f-fa76-4d3c-a463-4fcf8802ad12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3b5b45f19243378e7a6c9d093f8619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:39:19Z,use_quota=True,user_id='6ad98c44483d466aab7821c2b75da0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17899068-186b-4a28-a278-4e9b77009000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17899068-186b-4a28-a278-4e9b77009000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfb2c64-f2a6-4dc5-a4d6-280215ea0d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfb2c64-f2a6-4dc5-a4d6-280215ea0d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '303e358f-fa76-4d3c-a463-4fcf8802ad12', 'volume_name': 'volume-303e358f-fa76-4d3c-a463-4fcf8802ad12', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67377da8-8d46-4ccb-a71e-732723bab13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67377da8-8d46-4ccb-a71e-732723bab13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62bc1cc7-3db2-4ef6-bf75-48f28fd04994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:19 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Volume 303e358f-fa76-4d3c-a463-4fcf8802ad12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-303e358f-fa76-4d3c-a463-4fcf8802ad12', 'volume_size': 1} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1047785169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303e358f-fa76-4d3c-a463-4fcf8802ad12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3b5b45f19243378e7a6c9d093f8619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:39:19Z,use_quota=True,user_id='6ad98c44483d466aab7821c2b75da0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Creating volume 303e358f-fa76-4d3c-a463-4fcf8802ad12 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:39:19 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-303e358f-fa76-4d3c-a463-4fcf8802ad12 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:19 devstack sudo[92215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-303e358f-fa76-4d3c-a463-4fcf8802ad12 1073741824 Jul 08 02:39:19 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Acquiring lock "cinder-7b7dd9b3-fbf8-4109-8a76-ac57f167334d-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Lock "cinder-7b7dd9b3-fbf8-4109-8a76-ac57f167334d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Acquiring lock "cinder-quobyte-7b7dd9b3-fbf8-4109-8a76-ac57f167334d" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Lock "cinder-quobyte-7b7dd9b3-fbf8-4109-8a76-ac57f167334d" acquired by "delete_volume" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf87ed43-4f14-4fcd-8476-3fe2ca987018]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:39:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b7dd9b3-fbf8-4109-8a76-ac57f167334d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:19 devstack sudo[92217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b7dd9b3-fbf8-4109-8a76-ac57f167334d Jul 08 02:39:19 devstack sudo[92217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:20 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-303e358f-fa76-4d3c-a463-4fcf8802ad12 1073741824" returned: 0 in 0.917s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-303e358f-fa76-4d3c-a463-4fcf8802ad12 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:20 devstack sudo[92289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-303e358f-fa76-4d3c-a463-4fcf8802ad12 Jul 08 02:39:20 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:20 devstack sudo[92217]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b7dd9b3-fbf8-4109-8a76-ac57f167334d" returned: 0 in 1.060s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b7dd9b3-fbf8-4109-8a76-ac57f167334d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:20 devstack sudo[92306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b7dd9b3-fbf8-4109-8a76-ac57f167334d Jul 08 02:39:20 devstack sudo[92306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:21 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-303e358f-fa76-4d3c-a463-4fcf8802ad12" returned: 0 in 0.897s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:39:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62bc1cc7-3db2-4ef6-bf75-48f28fd04994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-303e358f-fa76-4d3c-a463-4fcf8802ad12', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de9e1fd-3be2-4985-9cc9-973bb2a8e0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:21 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Volume volume-303e358f-fa76-4d3c-a463-4fcf8802ad12 (303e358f-fa76-4d3c-a463-4fcf8802ad12): created successfully Jul 08 02:39:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de9e1fd-3be2-4985-9cc9-973bb2a8e0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Flow 'volume_create_manager' (838b5976-4305-4a37-aa1c-6101107fe3e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:39:21 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-7dd2d3f6-e3f8-49a5-bdb4-c03b9453a5c6 tempest-AttachVolumeNegativeTest-1281536783 None] Created volume successfully. Jul 08 02:39:21 devstack sudo[92306]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b7dd9b3-fbf8-4109-8a76-ac57f167334d" returned: 0 in 0.858s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Lock "cinder-quobyte-7b7dd9b3-fbf8-4109-8a76-ac57f167334d" released by "delete_volume" :: held 1.962s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:21 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Created reservations ['c23948ac-6740-47f6-ba2e-d1c21cba0a36', '33eadc6c-bd5e-4c47-b65c-5438b304a33f', '93c378cc-82e1-4a80-bb44-36830e1fc358', '3b978ffe-b894-4c22-a2c2-6ff0aaf504fc'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:39:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:21 devstack sudo[92318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:39:21 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Flow 'volume_create_manager' (68cf2bef-5327-4fc7-91b5-173f0b4f88cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f898d1b-5203-4aef-b41d-6722a5738d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f898d1b-5203-4aef-b41d-6722a5738d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-758540519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a54c98b-7c7b-4b8b-9781-c88460d2190b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3e4f75f252484ea1e9f9ecc7009916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:39:23Z,use_quota=True,user_id='a8d6853714c04b56955f3b24123c3571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692c2644-d22c-457e-a08a-274cead4e5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:22 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692c2644-d22c-457e-a08a-274cead4e5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c90271e-ae98-4746-9613-760e13032d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c90271e-ae98-4746-9613-760e13032d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a54c98b-7c7b-4b8b-9781-c88460d2190b', 'volume_name': 'volume-6a54c98b-7c7b-4b8b-9781-c88460d2190b', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591e0190-228c-49fe-a457-c66d93168b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591e0190-228c-49fe-a457-c66d93168b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a0972a-1047-4ed6-9f68-2c942127e459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:22 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Volume 6a54c98b-7c7b-4b8b-9781-c88460d2190b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a54c98b-7c7b-4b8b-9781-c88460d2190b', 'volume_size': 1} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-758540519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a54c98b-7c7b-4b8b-9781-c88460d2190b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3e4f75f252484ea1e9f9ecc7009916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:39:23Z,use_quota=True,user_id='a8d6853714c04b56955f3b24123c3571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Creating volume 6a54c98b-7c7b-4b8b-9781-c88460d2190b {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:39:22 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6a54c98b-7c7b-4b8b-9781-c88460d2190b 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.045s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:23 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:39:23 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Deleted volume successfully. Jul 08 02:39:23 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6a54c98b-7c7b-4b8b-9781-c88460d2190b 1073741824 Jul 08 02:39:23 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6fcc0f15-ea38-4407-b908-d07b9e583c1a tempest-VolumesActionsTest-106032596 None] Lock "cinder-7b7dd9b3-fbf8-4109-8a76-ac57f167334d-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:23 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6a54c98b-7c7b-4b8b-9781-c88460d2190b 1073741824" returned: 0 in 0.861s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6a54c98b-7c7b-4b8b-9781-c88460d2190b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:23 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6a54c98b-7c7b-4b8b-9781-c88460d2190b Jul 08 02:39:23 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:24 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6a54c98b-7c7b-4b8b-9781-c88460d2190b" returned: 0 in 0.692s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:39:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a0972a-1047-4ed6-9f68-2c942127e459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a54c98b-7c7b-4b8b-9781-c88460d2190b', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6943d6c-fac3-4651-847e-f8b8dce37209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:24 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Volume volume-6a54c98b-7c7b-4b8b-9781-c88460d2190b (6a54c98b-7c7b-4b8b-9781-c88460d2190b): created successfully Jul 08 02:39:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6943d6c-fac3-4651-847e-f8b8dce37209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Flow 'volume_create_manager' (68cf2bef-5327-4fc7-91b5-173f0b4f88cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:39:24 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-735a77f3-34dd-4439-a10e-cd27803a8445 tempest-VolumesActionsTest-999607813 None] Created volume successfully. Jul 08 02:39:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Acquiring lock "cinder-6a54c98b-7c7b-4b8b-9781-c88460d2190b-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Lock "cinder-6a54c98b-7c7b-4b8b-9781-c88460d2190b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Acquiring lock "cinder-quobyte-6a54c98b-7c7b-4b8b-9781-c88460d2190b" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Lock "cinder-quobyte-6a54c98b-7c7b-4b8b-9781-c88460d2190b" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:25 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5374e98-cd23-4df6-bcea-c4bb8eeec9b2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:39:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6a54c98b-7c7b-4b8b-9781-c88460d2190b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:25 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6a54c98b-7c7b-4b8b-9781-c88460d2190b Jul 08 02:39:25 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-73180175-4ba8-4325-aee1-f0a7b95fc580 req-468fa705-0ba0-4995-a4f8-b1c0f010e7dd tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-73180175-4ba8-4325-aee1-f0a7b95fc580 req-468fa705-0ba0-4995-a4f8-b1c0f010e7dd tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[e589392c-eccc-4de1-af2d-40c304de3211]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-73180175-4ba8-4325-aee1-f0a7b95fc580 req-468fa705-0ba0-4995-a4f8-b1c0f010e7dd tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-303e358f-fa76-4d3c-a463-4fcf8802ad12 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:26 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6a54c98b-7c7b-4b8b-9781-c88460d2190b" returned: 0 in 0.924s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6a54c98b-7c7b-4b8b-9781-c88460d2190b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:26 devstack sudo[92686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6a54c98b-7c7b-4b8b-9781-c88460d2190b Jul 08 02:39:26 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:26 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-303e358f-fa76-4d3c-a463-4fcf8802ad12 Jul 08 02:39:26 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:26 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6a54c98b-7c7b-4b8b-9781-c88460d2190b" returned: 0 in 0.690s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Lock "cinder-quobyte-6a54c98b-7c7b-4b8b-9781-c88460d2190b" released by "delete_volume" :: held 1.667s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Created reservations ['59dea790-fdc5-46c3-8c3a-3db694bf9733', '3ead5b3f-40bd-48a5-9687-c7729decad01', 'cb658ee8-6cf8-4dc7-bcda-d09b60093054', 'a382f512-8b74-400a-8fb2-6c871f11a4f7'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:26 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:39:26 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:26 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-73180175-4ba8-4325-aee1-f0a7b95fc580 req-468fa705-0ba0-4995-a4f8-b1c0f010e7dd tempest-AttachVolumeNegativeTest-1281536783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-303e358f-fa76-4d3c-a463-4fcf8802ad12" returned: 0 in 0.906s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-73180175-4ba8-4325-aee1-f0a7b95fc580 req-468fa705-0ba0-4995-a4f8-b1c0f010e7dd tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.931s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:26 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-73180175-4ba8-4325-aee1-f0a7b95fc580 req-468fa705-0ba0-4995-a4f8-b1c0f010e7dd tempest-AttachVolumeNegativeTest-1281536783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-303e358f-fa76-4d3c-a463-4fcf8802ad12', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8bbee4a-7a68-4314-82c1-b74f07a88183', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:39:27 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-73180175-4ba8-4325-aee1-f0a7b95fc580 req-468fa705-0ba0-4995-a4f8-b1c0f010e7dd tempest-AttachVolumeNegativeTest-1281536783 None] attachment_update completed successfully. Jul 08 02:39:27 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.713s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:39:27 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Deleted volume successfully. Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93a0f15b-6a0c-4930-80dd-4271f50b880c tempest-VolumesActionsTest-106032596 None] Lock "cinder-6a54c98b-7c7b-4b8b-9781-c88460d2190b-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Flow 'volume_create_manager' (4a9ff6dc-8da5-4f62-adbe-649e097b0eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e298bd1e-3def-49f0-87e7-bc1b395069e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e298bd1e-3def-49f0-87e7-bc1b395069e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2111126581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ff3356-d875-46d1-ad80-53fcbedf9cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3e4f75f252484ea1e9f9ecc7009916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:39:28Z,use_quota=True,user_id='a8d6853714c04b56955f3b24123c3571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d156fa09-b4dd-40c1-b6ab-3fb29fad4f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d156fa09-b4dd-40c1-b6ab-3fb29fad4f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139d2dd0-2f9b-4060-a483-d08a268e0afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139d2dd0-2f9b-4060-a483-d08a268e0afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ff3356-d875-46d1-ad80-53fcbedf9cf2', 'volume_name': 'volume-a3ff3356-d875-46d1-ad80-53fcbedf9cf2', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc722f1-3dbd-4d17-8984-bffab8aa7830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc722f1-3dbd-4d17-8984-bffab8aa7830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0a8c2b-f915-4b55-96d5-036de98f9053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:27 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Volume a3ff3356-d875-46d1-ad80-53fcbedf9cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ff3356-d875-46d1-ad80-53fcbedf9cf2', 'volume_size': 1} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2111126581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ff3356-d875-46d1-ad80-53fcbedf9cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3e4f75f252484ea1e9f9ecc7009916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:39:28Z,use_quota=True,user_id='a8d6853714c04b56955f3b24123c3571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Creating volume a3ff3356-d875-46d1-ad80-53fcbedf9cf2 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:39:27 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:39:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3ff3356-d875-46d1-ad80-53fcbedf9cf2 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:27 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3ff3356-d875-46d1-ad80-53fcbedf9cf2 1073741824 Jul 08 02:39:27 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:28 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3ff3356-d875-46d1-ad80-53fcbedf9cf2 1073741824" returned: 0 in 0.931s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3ff3356-d875-46d1-ad80-53fcbedf9cf2 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:28 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3ff3356-d875-46d1-ad80-53fcbedf9cf2 Jul 08 02:39:28 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:29 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3ff3356-d875-46d1-ad80-53fcbedf9cf2" returned: 0 in 0.669s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:39:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0a8c2b-f915-4b55-96d5-036de98f9053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ff3356-d875-46d1-ad80-53fcbedf9cf2', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60ad980-6529-40cf-89ba-277af6c61d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:29 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Volume volume-a3ff3356-d875-46d1-ad80-53fcbedf9cf2 (a3ff3356-d875-46d1-ad80-53fcbedf9cf2): created successfully Jul 08 02:39:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60ad980-6529-40cf-89ba-277af6c61d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Flow 'volume_create_manager' (4a9ff6dc-8da5-4f62-adbe-649e097b0eaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:39:29 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c12263a5-b436-45db-a4e7-f046deac34d5 tempest-VolumesActionsTest-999607813 None] Created volume successfully. Jul 08 02:39:30 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Acquiring lock "cinder-a3ff3356-d875-46d1-ad80-53fcbedf9cf2-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:30 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Lock "cinder-a3ff3356-d875-46d1-ad80-53fcbedf9cf2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:30 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Acquiring lock "cinder-quobyte-a3ff3356-d875-46d1-ad80-53fcbedf9cf2" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:30 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Lock "cinder-quobyte-a3ff3356-d875-46d1-ad80-53fcbedf9cf2" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:30 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9ba4fd-eb6d-481b-aaba-2b0d209d5d38]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:39:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3ff3356-d875-46d1-ad80-53fcbedf9cf2 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:30 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3ff3356-d875-46d1-ad80-53fcbedf9cf2 Jul 08 02:39:30 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:30 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3ff3356-d875-46d1-ad80-53fcbedf9cf2" returned: 0 in 0.794s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3ff3356-d875-46d1-ad80-53fcbedf9cf2 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:30 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3ff3356-d875-46d1-ad80-53fcbedf9cf2 Jul 08 02:39:30 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:31 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3ff3356-d875-46d1-ad80-53fcbedf9cf2" returned: 0 in 0.696s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:31 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Lock "cinder-quobyte-a3ff3356-d875-46d1-ad80-53fcbedf9cf2" released by "delete_volume" :: held 1.533s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:31 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Created reservations ['7554faf6-c0c2-4970-9a5c-87d3bb337667', 'c7a6c751-c632-46d8-8ee0-a6552621124e', '6f1a5068-542e-44fb-8572-a22bac59594c', 'a21e37fe-4049-4dfc-b4ea-4ef39db7a52f'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:39:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:31 devstack sudo[92722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:39:31 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:32 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.638s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:39:32 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Deleted volume successfully. Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-325e96fa-c221-4397-a0b0-c4ce0dabdfdb tempest-VolumesActionsTest-106032596 None] Lock "cinder-a3ff3356-d875-46d1-ad80-53fcbedf9cf2-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Flow 'volume_create_manager' (639084a4-4fe7-4527-84d4-c08b7d77b1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c16e52-0445-4cd4-a1ed-11c00dd79f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c16e52-0445-4cd4-a1ed-11c00dd79f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-374612028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6947f666-a898-4283-87cb-77b5289b3b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3e4f75f252484ea1e9f9ecc7009916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:39:33Z,use_quota=True,user_id='a8d6853714c04b56955f3b24123c3571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ded000-0bcb-41dd-b426-4232e92ceed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ded000-0bcb-41dd-b426-4232e92ceed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56eafdb-ec2c-417b-960e-7e9f89c34ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56eafdb-ec2c-417b-960e-7e9f89c34ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6947f666-a898-4283-87cb-77b5289b3b79', 'volume_name': 'volume-6947f666-a898-4283-87cb-77b5289b3b79', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a249fbe-75cc-47e6-9160-b5c67e9540c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a249fbe-75cc-47e6-9160-b5c67e9540c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7c9d76-8174-4037-b0ba-82b136a064cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:32 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Volume 6947f666-a898-4283-87cb-77b5289b3b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6947f666-a898-4283-87cb-77b5289b3b79', 'volume_size': 1} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-374612028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6947f666-a898-4283-87cb-77b5289b3b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3e4f75f252484ea1e9f9ecc7009916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:39:33Z,use_quota=True,user_id='a8d6853714c04b56955f3b24123c3571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Creating volume 6947f666-a898-4283-87cb-77b5289b3b79 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:39:32 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:39:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6947f666-a898-4283-87cb-77b5289b3b79 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:32 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6947f666-a898-4283-87cb-77b5289b3b79 1073741824 Jul 08 02:39:33 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:33 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-6c0ad6ec-ed14-4210-b184-626135e2e42c req-0efe538a-c076-45fc-bdc0-cc9224174d30 tempest-AttachVolumeNegativeTest-1281536783 None] Terminate volume connection completed successfully. Jul 08 02:39:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-6c0ad6ec-ed14-4210-b184-626135e2e42c req-0efe538a-c076-45fc-bdc0-cc9224174d30 tempest-AttachVolumeNegativeTest-1281536783 None] Deleting attachment d8bbee4a-7a68-4314-82c1-b74f07a88183. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:39:33 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6947f666-a898-4283-87cb-77b5289b3b79 1073741824" returned: 0 in 0.926s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6947f666-a898-4283-87cb-77b5289b3b79 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:33 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6947f666-a898-4283-87cb-77b5289b3b79 Jul 08 02:39:33 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:34 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6947f666-a898-4283-87cb-77b5289b3b79" returned: 0 in 0.660s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:34 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:39:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7c9d76-8174-4037-b0ba-82b136a064cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6947f666-a898-4283-87cb-77b5289b3b79', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf7c1b65-476f-4e07-b800-a7a1a9366b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:34 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Volume volume-6947f666-a898-4283-87cb-77b5289b3b79 (6947f666-a898-4283-87cb-77b5289b3b79): created successfully Jul 08 02:39:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf7c1b65-476f-4e07-b800-a7a1a9366b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Flow 'volume_create_manager' (639084a4-4fe7-4527-84d4-c08b7d77b1bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:39:34 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-9251434b-d296-457e-9d51-bb4263159920 tempest-VolumesActionsTest-999607813 None] Created volume successfully. Jul 08 02:39:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Acquiring lock "cinder-6947f666-a898-4283-87cb-77b5289b3b79-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Lock "cinder-6947f666-a898-4283-87cb-77b5289b3b79-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Acquiring lock "cinder-quobyte-6947f666-a898-4283-87cb-77b5289b3b79" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Lock "cinder-quobyte-6947f666-a898-4283-87cb-77b5289b3b79" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:35 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4d44e4-1d47-4a9e-b4b9-74a14c9076ab]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:39:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6947f666-a898-4283-87cb-77b5289b3b79 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:36 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6947f666-a898-4283-87cb-77b5289b3b79 Jul 08 02:39:36 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:36 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6947f666-a898-4283-87cb-77b5289b3b79" returned: 0 in 0.884s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6947f666-a898-4283-87cb-77b5289b3b79 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:36 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6947f666-a898-4283-87cb-77b5289b3b79 Jul 08 02:39:36 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:37 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6947f666-a898-4283-87cb-77b5289b3b79" returned: 0 in 0.789s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Lock "cinder-quobyte-6947f666-a898-4283-87cb-77b5289b3b79" released by "delete_volume" :: held 1.748s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:37 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Created reservations ['06137dea-d4b2-4e82-ba5f-cb66573e3c1c', '84d577c1-0905-4543-9d70-fc819a612c4d', 'b33432dc-8344-48c5-bb3c-edfc92173920', '6f69fc68-b9fe-435e-8af8-2c55b3ffa3c0'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:39:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:37 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:39:37 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:38 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.844s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:38 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:39:38 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Deleted volume successfully. Jul 08 02:39:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0bdbebb0-7f47-4c62-9ad7-70c117ee2849 tempest-VolumesActionsTest-999607813 None] Lock "cinder-6947f666-a898-4283-87cb-77b5289b3b79-delete_volume" released by "delete_volume" :: held 2.933s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "cinder-303e358f-fa76-4d3c-a463-4fcf8802ad12-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Lock "cinder-303e358f-fa76-4d3c-a463-4fcf8802ad12-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:43 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=79,cinder:UPDATE=77,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:39:43 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=78,cinder:SELECT=62,cinder:INSERT=17,cinder:DELETE=9 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:39:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "cinder-quobyte-303e358f-fa76-4d3c-a463-4fcf8802ad12" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Lock "cinder-quobyte-303e358f-fa76-4d3c-a463-4fcf8802ad12" acquired by "delete_volume" :: waited 0.035s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:43 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[98008e4a-a543-40ff-a242-711da0f02631]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:39:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-303e358f-fa76-4d3c-a463-4fcf8802ad12 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:43 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-303e358f-fa76-4d3c-a463-4fcf8802ad12 Jul 08 02:39:43 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:44 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-303e358f-fa76-4d3c-a463-4fcf8802ad12" returned: 0 in 0.907s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-303e358f-fa76-4d3c-a463-4fcf8802ad12 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:44 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-303e358f-fa76-4d3c-a463-4fcf8802ad12 Jul 08 02:39:44 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:45 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-303e358f-fa76-4d3c-a463-4fcf8802ad12" returned: 0 in 0.873s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Lock "cinder-quobyte-303e358f-fa76-4d3c-a463-4fcf8802ad12" released by "delete_volume" :: held 1.849s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Created reservations ['ca722dab-cb06-49b1-b498-13c6eb6969a7', '9687ee10-c3a4-417a-b945-ae76b1710c8a', '448ba977-4a5b-43ff-8cc7-c20bdede1d3b', 'b5cbc6ab-e461-41fa-8a59-e8790ab7f255'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:45 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:39:45 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Acquiring lock "cinder-429da162-7f2e-43ad-8e44-b9bf4fc3de6b-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Lock "cinder-429da162-7f2e-43ad-8e44-b9bf4fc3de6b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "cinder-0d88d84b-e300-4eba-8e46-1098f2880477-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Lock "cinder-0d88d84b-e300-4eba-8e46-1098f2880477-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Acquiring lock "cinder-quobyte-429da162-7f2e-43ad-8e44-b9bf4fc3de6b" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Lock "cinder-quobyte-429da162-7f2e-43ad-8e44-b9bf4fc3de6b" acquired by "delete_volume" :: waited 0.041s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "cinder-quobyte-0d88d84b-e300-4eba-8e46-1098f2880477" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdedf537-88ca-4cc1-8e46-2ea1c861d300]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Lock "cinder-quobyte-0d88d84b-e300-4eba-8e46-1098f2880477" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-429da162-7f2e-43ad-8e44-b9bf4fc3de6b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c775ea5-0ce5-4048-b406-bdc6be319c6e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:39:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0d88d84b-e300-4eba-8e46-1098f2880477 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:46 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-429da162-7f2e-43ad-8e44-b9bf4fc3de6b Jul 08 02:39:46 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:46 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0d88d84b-e300-4eba-8e46-1098f2880477 Jul 08 02:39:46 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:46 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.082s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:46 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:39:46 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Deleted volume successfully. Jul 08 02:39:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8cc49dd7-1ce5-43f0-9245-bd69bfe840bb tempest-AttachVolumeNegativeTest-1281536783 None] Lock "cinder-303e358f-fa76-4d3c-a463-4fcf8802ad12-delete_volume" released by "delete_volume" :: held 3.526s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:46 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-429da162-7f2e-43ad-8e44-b9bf4fc3de6b" returned: 0 in 1.074s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-429da162-7f2e-43ad-8e44-b9bf4fc3de6b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:47 devstack sudo[92880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-429da162-7f2e-43ad-8e44-b9bf4fc3de6b Jul 08 02:39:47 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:47 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0d88d84b-e300-4eba-8e46-1098f2880477" returned: 0 in 1.127s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0d88d84b-e300-4eba-8e46-1098f2880477 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:47 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0d88d84b-e300-4eba-8e46-1098f2880477 Jul 08 02:39:47 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:39:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:47 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:39:47 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:47 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0d88d84b-e300-4eba-8e46-1098f2880477" returned: 0 in 0.780s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:47 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Lock "cinder-quobyte-0d88d84b-e300-4eba-8e46-1098f2880477" released by "delete_volume" :: held 1.972s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-429da162-7f2e-43ad-8e44-b9bf4fc3de6b" returned: 0 in 0.888s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Lock "cinder-quobyte-429da162-7f2e-43ad-8e44-b9bf4fc3de6b" released by "delete_volume" :: held 2.054s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Created reservations ['0fe981f0-230d-4809-9c54-ea05e884a8a8', 'c19a1473-40d9-4ec9-b7e8-5153f7b86f3c', '5cfbdbed-b01f-4457-927e-745211277ff7', 'f43b2e3d-fc02-420d-846d-cb993d9f1015'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Created reservations ['6481a248-ebf8-40f0-9d05-7a91a36c3fbf', '1696b9fc-3759-46a6-8759-36fc8204f4d8', '713a6a96-b330-438d-9c9c-79e2910f3d16', '693f6777-3326-4588-b914-ae0aaa0eacf0'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:48 devstack sudo[92890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:39:48 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:48 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.967s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 8 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:39:48 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:39:48 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:48 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-fe78c403-7796-4596-a49f-3de1dfa5fc96 req-9110b245-92aa-4ebd-a48b-0bda65309b16 tempest-ServerActionsTestOtherA-1294969195 None] Terminate volume connection completed successfully. Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-fe78c403-7796-4596-a49f-3de1dfa5fc96 req-9110b245-92aa-4ebd-a48b-0bda65309b16 tempest-ServerActionsTestOtherA-1294969195 None] Deleting attachment 7b8ba460-9398-45ca-8afa-154cf93da103. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:39:48 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.790s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:39:49 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:49 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Deleted volume successfully. Jul 08 02:39:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.878s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:49 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:39:49 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Deleted volume successfully. Jul 08 02:39:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5887e436-0fdf-4531-a673-54ae0f95e275 tempest-AttachVolumeShelveTestJSON-1344777832 None] Lock "cinder-429da162-7f2e-43ad-8e44-b9bf4fc3de6b-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a4c57b4e-1945-46e4-9fa4-2b77cd6cbca2 tempest-AttachVolumeNegativeTest-1281536783 None] Lock "cinder-0d88d84b-e300-4eba-8e46-1098f2880477-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "cinder-cb648230-5b2a-4efa-bc0e-dacc64822a5d-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Lock "cinder-cb648230-5b2a-4efa-bc0e-dacc64822a5d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "cinder-quobyte-cb648230-5b2a-4efa-bc0e-dacc64822a5d" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:39:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Lock "cinder-quobyte-cb648230-5b2a-4efa-bc0e-dacc64822a5d" acquired by "delete_volume" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:39:49 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[4192561a-1820-46ea-a56f-e6d482fbdd4b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:39:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:49 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d Jul 08 02:39:49 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:50 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d" returned: 0 in 0.962s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:50 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d Jul 08 02:39:50 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:51 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb648230-5b2a-4efa-bc0e-dacc64822a5d" returned: 0 in 0.764s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Lock "cinder-quobyte-cb648230-5b2a-4efa-bc0e-dacc64822a5d" released by "delete_volume" :: held 1.792s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:51 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Created reservations ['400d6190-9209-4611-b38b-13af9530a11e', '78ab5ee0-fa41-4c0f-9e93-977c5fda069b', '3be13b3c-75d8-47c5-a7cb-5f010fd33ded', '0e863946-b498-445b-a3bc-054f6e6ed0cf'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:39:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:39:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:39:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:39:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:39:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:39:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:51 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:39:51 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:52 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.862s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:52 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:39:52 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Deleted volume successfully. Jul 08 02:39:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-82bc1f26-3d42-492d-9ec5-43c89455e69b tempest-AttachVolumeNegativeTest-1281536783 None] Lock "cinder-cb648230-5b2a-4efa-bc0e-dacc64822a5d-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:39:56 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:39:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Flow 'volume_create_manager' (3b40267f-9280-472a-846c-82b747c55716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:39:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90176df-56d2-48f4-8d09-1fc3c433c6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90176df-56d2-48f4-8d09-1fc3c433c6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-736941766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03ff8cf9b284b3d86fea548e5c7f21e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:39:56Z,use_quota=True,user_id='efb892529801434ba5cbd0c16fa1ea33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6130b5ed-6103-401c-bcaf-c6044b53f224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6130b5ed-6103-401c-bcaf-c6044b53f224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936e5523-a39f-48fe-8115-da3677c1e351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:56 devstack cinder-volume[87238]: DEBUG cinder.image.glance [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Creating Keystone auth plugin from conf {{(pid=87238) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 02:39:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936e5523-a39f-48fe-8115-da3677c1e351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170', 'volume_name': 'volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170', 'volume_size': 1, 'image_id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a21b7084cd94a8dbdfabbb9ed31db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'created_at': datetime.datetime(2026, 7, 8, 0, 29, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 29, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d652479-1a49-4785-9fa6-62d5f48b409f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618141d5-c890-4348-a286-7582f73b0f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618141d5-c890-4348-a286-7582f73b0f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:39:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95e97c4-b9f7-4971-86bb-09476f52c3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:39:57 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Volume 9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170', 'volume_size': 1, 'image_id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a21b7084cd94a8dbdfabbb9ed31db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'created_at': datetime.datetime(2026, 7, 8, 0, 29, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 29, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d652479-1a49-4785-9fa6-62d5f48b409f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 02:39:57 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Trying to clone 9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 from image 9d652479-1a49-4785-9fa6-62d5f48b409f at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}]). {{(pid=87238) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 02:39:58 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_q60l671edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 02:39:58 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Image download 20.69 MB at 20.69 MB/s Jul 08 02:39:58 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[510d82ea-6da3-498d-98d4-03c7c25c12d3]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:39:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_q60l671edevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:58 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_q60l671edevstack@QuobyteHD Jul 08 02:39:58 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:39:59 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Jul 08 02:39:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_q60l671edevstack@QuobyteHD" returned: 0 in 0.921s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:39:59 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Temporary image 9d652479-1a49-4785-9fa6-62d5f48b409f is fetched for user efb892529801434ba5cbd0c16fa1ea33. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 02:39:59 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f405230c-aea6-4a68-8db2-e2a9dbb5520f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:39:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_q60l671edevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:39:59 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_q60l671edevstack@QuobyteHD Jul 08 02:39:59 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Acquiring lock "cinder-8b90c5dd-1f0f-4aec-882d-7eaa782b9875-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:00 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_q60l671edevstack@QuobyteHD" returned: 0 in 1.209s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-736941766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03ff8cf9b284b3d86fea548e5c7f21e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:39:56Z,use_quota=True,user_id='efb892529801434ba5cbd0c16fa1ea33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Creating volume 9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:40:00 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Lock "cinder-8b90c5dd-1f0f-4aec-882d-7eaa782b9875-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:00 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 1073741824 Jul 08 02:40:00 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Acquiring lock "cinder-quobyte-8b90c5dd-1f0f-4aec-882d-7eaa782b9875" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Lock "cinder-quobyte-8b90c5dd-1f0f-4aec-882d-7eaa782b9875" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb2f290-8927-428e-801b-87f0406f6035]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:00 devstack sudo[92976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875 Jul 08 02:40:00 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:01 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 1073741824" returned: 0 in 1.047s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:01 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875" returned: 0 in 0.955s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:01 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875 Jul 08 02:40:01 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:01 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 Jul 08 02:40:01 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:02 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8b90c5dd-1f0f-4aec-882d-7eaa782b9875" returned: 0 in 0.767s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Lock "cinder-quobyte-8b90c5dd-1f0f-4aec-882d-7eaa782b9875" released by "delete_volume" :: held 1.780s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:02 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170" returned: 0 in 0.768s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Attempting download of 9d652479-1a49-4785-9fa6-62d5f48b409f ((None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}])) to volume 9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Created reservations ['9036e5b1-e588-453a-9f0b-99bcd46cfb23', 'ace8e123-e23e-497a-a902-57e51a5c3e9a', 'afc26507-f5bc-4271-81f1-c319f9f47057', '9a12d14a-7639-49de-a593-2a192d3dde4c'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f438d61e-a0fa-427a-8dac-87141a752c7d]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_ycb9ky7x {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:02 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:40:02 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:02 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_ycb9ky7x Jul 08 02:40:02 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Flow 'volume_create_manager' (caff8c10-34fb-441f-937a-a46d9bb06feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec67b399-7501-4109-acdb-07b05ea6b48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec67b399-7501-4109-acdb-07b05ea6b48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1521196751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f0687e-27d9-4fea-941a-4d31df04a60e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eba45770b836473485467dc3f50ea08e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:40:03Z,use_quota=True,user_id='999deb63d36a45f89fe49a7ca3b6fc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388769f2-b43e-45c0-a034-f394b20b07b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388769f2-b43e-45c0-a034-f394b20b07b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c732fc8-5f0a-40e6-af88-65113ec357d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c732fc8-5f0a-40e6-af88-65113ec357d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7f0687e-27d9-4fea-941a-4d31df04a60e', 'volume_name': 'volume-d7f0687e-27d9-4fea-941a-4d31df04a60e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7025d2-df95-4047-9fd1-e6716d21e6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7025d2-df95-4047-9fd1-e6716d21e6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c14e2bd-ad2e-450f-8b82-67048e199b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:02 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Volume d7f0687e-27d9-4fea-941a-4d31df04a60e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7f0687e-27d9-4fea-941a-4d31df04a60e', 'volume_size': 1} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1521196751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f0687e-27d9-4fea-941a-4d31df04a60e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eba45770b836473485467dc3f50ea08e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:40:03Z,use_quota=True,user_id='999deb63d36a45f89fe49a7ca3b6fc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Creating volume d7f0687e-27d9-4fea-941a-4d31df04a60e {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:40:02 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:40:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d7f0687e-27d9-4fea-941a-4d31df04a60e 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:02 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d7f0687e-27d9-4fea-941a-4d31df04a60e 1073741824 Jul 08 02:40:02 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:03 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_ycb9ky7x" returned: 0 in 0.859s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_ycb9ky7x {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:03 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_ycb9ky7x Jul 08 02:40:03 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:03 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.038s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:03 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:40:03 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Deleted volume successfully. Jul 08 02:40:03 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-138b1e79-38b1-402f-ae7c-bbbe966035ef tempest-ServerActionsTestOtherA-1294969195 None] Lock "cinder-8b90c5dd-1f0f-4aec-882d-7eaa782b9875-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:03 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d7f0687e-27d9-4fea-941a-4d31df04a60e 1073741824" returned: 0 in 1.099s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d7f0687e-27d9-4fea-941a-4d31df04a60e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:04 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d7f0687e-27d9-4fea-941a-4d31df04a60e Jul 08 02:40:04 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:04 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-27a069d9-cc14-49dc-91d3-a5d8f9713be9 tempest-GroupSnapshotsTest-910327665 None] Group tempest-GroupSnapshotsTest-Group-1984678242: creating Jul 08 02:40:04 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-27a069d9-cc14-49dc-91d3-a5d8f9713be9 tempest-GroupSnapshotsTest-910327665 None] Group tempest-GroupSnapshotsTest-Group-1984678242: created successfully Jul 08 02:40:04 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-27a069d9-cc14-49dc-91d3-a5d8f9713be9 tempest-GroupSnapshotsTest-910327665 None] Create group completed successfully. Jul 08 02:40:04 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_ycb9ky7x" returned: 1 in 0.947s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_ycb9ky7x' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:40:04 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dcf704-8822-45f2-ab49-efd9c1ee6ffe]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_q60l671edevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:04 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_q60l671edevstack@QuobyteHD Jul 08 02:40:04 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:04 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d7f0687e-27d9-4fea-941a-4d31df04a60e" returned: 0 in 0.844s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:40:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c14e2bd-ad2e-450f-8b82-67048e199b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7f0687e-27d9-4fea-941a-4d31df04a60e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ea7398-a29d-4785-a110-3c532aa52b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:04 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Volume volume-d7f0687e-27d9-4fea-941a-4d31df04a60e (d7f0687e-27d9-4fea-941a-4d31df04a60e): created successfully Jul 08 02:40:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ea7398-a29d-4785-a110-3c532aa52b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Flow 'volume_create_manager' (caff8c10-34fb-441f-937a-a46d9bb06feb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:04 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ce6d3531-1d85-4446-9665-052dc601e112 tempest-VolumesTestJSON-322266156 None] Created volume successfully. Jul 08 02:40:05 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_q60l671edevstack@QuobyteHD" returned: 0 in 0.923s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:05 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] 9d652479-1a49-4785-9fa6-62d5f48b409f was qcow2, converting to raw {{(pid=87238) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 02:40:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_q60l671edevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:05 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_q60l671edevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 Jul 08 02:40:05 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:05 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:40:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Flow 'volume_create_manager' (9c6c069b-399b-49c4-aa91-72b0fa2624f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69319103-c452-4138-b820-b7b67a77dcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69319103-c452-4138-b820-b7b67a77dcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1770360499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b25df7d1-c210-4a71-ab3f-63d47e911a06,host='devstack@QuobyteHD#QuobyteHD',id=512251a0-f58d-4c4f-b184-d9644b148e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323f0bb16974456ca1b52bf702ba40a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:40:06Z,use_quota=True,user_id='fba714f94dcb4e55ab174ee5da641c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b21e521e-1673-4dd1-8f87-45505713ea50),volume_type_id=b21e521e-1673-4dd1-8f87-45505713ea50)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cf074e-c84e-4959-9433-8f1f9a6cf5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cf074e-c84e-4959-9433-8f1f9a6cf5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde68f71-4b0f-410f-8f7d-bbfa6dd737f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde68f71-4b0f-410f-8f7d-bbfa6dd737f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '512251a0-f58d-4c4f-b184-d9644b148e93', 'volume_name': 'volume-512251a0-f58d-4c4f-b184-d9644b148e93', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf362f5-63e7-46ab-85f7-ae77670da37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf362f5-63e7-46ab-85f7-ae77670da37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070b026c-bf5a-45cb-b781-2d23876d38ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:06 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Volume 512251a0-f58d-4c4f-b184-d9644b148e93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-512251a0-f58d-4c4f-b184-d9644b148e93', 'volume_size': 1} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b25df7d1-c210-4a71-ab3f-63d47e911a06,created_at=2026-07-08T00:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1770360499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b25df7d1-c210-4a71-ab3f-63d47e911a06,host='devstack@QuobyteHD#QuobyteHD',id=512251a0-f58d-4c4f-b184-d9644b148e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323f0bb16974456ca1b52bf702ba40a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:40:06Z,use_quota=True,user_id='fba714f94dcb4e55ab174ee5da641c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b21e521e-1673-4dd1-8f87-45505713ea50),volume_type_id=b21e521e-1673-4dd1-8f87-45505713ea50)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Creating volume 512251a0-f58d-4c4f-b184-d9644b148e93 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:40:06 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:06 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 1073741824 Jul 08 02:40:06 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Flow 'volume_create_manager' (365296ec-e8d0-4298-b7ed-2bf88d3879a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddbd48c-05fe-4c7f-9586-efbbdeed7990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddbd48c-05fe-4c7f-9586-efbbdeed7990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1730133713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49646f2d-6971-4a33-b4ff-9cd32c291555,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eba45770b836473485467dc3f50ea08e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:40:07Z,use_quota=True,user_id='999deb63d36a45f89fe49a7ca3b6fc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfecba7d-db55-456b-943b-8350ac28c0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfecba7d-db55-456b-943b-8350ac28c0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c955a7-9edc-4e9b-84e4-7302f8af678e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c955a7-9edc-4e9b-84e4-7302f8af678e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49646f2d-6971-4a33-b4ff-9cd32c291555', 'volume_name': 'volume-49646f2d-6971-4a33-b4ff-9cd32c291555', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a69bb5-fafb-4147-a5fb-e7ad5bb8773a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a69bb5-fafb-4147-a5fb-e7ad5bb8773a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13ec94d-e9cf-43a1-bedf-5a5069d3b72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:06 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Volume 49646f2d-6971-4a33-b4ff-9cd32c291555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49646f2d-6971-4a33-b4ff-9cd32c291555', 'volume_size': 1} Jul 08 02:40:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:07 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 1073741824" returned: 0 in 1.147s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:07 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 Jul 08 02:40:07 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:07 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_q60l671edevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170" returned: 0 in 2.481s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_q60l671edevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:40:07 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Converted 112.00 MB image at 45.13 MB/s Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:07 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 1G Jul 08 02:40:07 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:07 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93" returned: 0 in 0.702s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.117s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1730133713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49646f2d-6971-4a33-b4ff-9cd32c291555,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eba45770b836473485467dc3f50ea08e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:40:07Z,use_quota=True,user_id='999deb63d36a45f89fe49a7ca3b6fc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Creating volume 49646f2d-6971-4a33-b4ff-9cd32c291555 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:40:07 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-49646f2d-6971-4a33-b4ff-9cd32c291555 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:07 devstack sudo[93068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-49646f2d-6971-4a33-b4ff-9cd32c291555 1073741824 Jul 08 02:40:07 devstack sudo[93068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070b026c-bf5a-45cb-b781-2d23876d38ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-512251a0-f58d-4c4f-b184-d9644b148e93', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe3ba6a-ad5e-4909-bc6b-f47229499aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:07 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Volume volume-512251a0-f58d-4c4f-b184-d9644b148e93 (512251a0-f58d-4c4f-b184-d9644b148e93): created successfully Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe3ba6a-ad5e-4909-bc6b-f47229499aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Flow 'volume_create_manager' (9c6c069b-399b-49c4-aa91-72b0fa2624f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:08 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-73e5a6d2-12cd-40b2-8472-54ab17a86e16 tempest-GroupSnapshotsTest-910327665 None] Created volume successfully. Jul 08 02:40:08 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 1G" returned: 0 in 0.768s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:08 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f70c40-2f63-42ac-aa26-a5ad49d67458]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:08 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 Jul 08 02:40:08 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:08 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] GroupSnapshot 7dc072b9-3228-4269-8ed1-988f5876d40b: creating. Jul 08 02:40:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] Group snapshot 7dc072b9-3228-4269-8ed1-988f5876d40b: creating. {{(pid=87238) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 02:40:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:08 devstack sudo[93068]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-49646f2d-6971-4a33-b4ff-9cd32c291555 1073741824" returned: 0 in 0.918s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-49646f2d-6971-4a33-b4ff-9cd32c291555 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:08 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-49646f2d-6971-4a33-b4ff-9cd32c291555 Jul 08 02:40:08 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:09 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170" returned: 0 in 0.823s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:09 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 Jul 08 02:40:09 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:09 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-49646f2d-6971-4a33-b4ff-9cd32c291555" returned: 0 in 0.660s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:40:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.836s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13ec94d-e9cf-43a1-bedf-5a5069d3b72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49646f2d-6971-4a33-b4ff-9cd32c291555', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc47cf51-8c14-4bbf-ae6f-39f365798b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] Creating offline snapshot c9a7c121-f022-4955-a6c3-889a534f2c32 of volume 512251a0-f58d-4c4f-b184-d9644b148e93 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:40:09 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Volume volume-49646f2d-6971-4a33-b4ff-9cd32c291555 (49646f2d-6971-4a33-b4ff-9cd32c291555): created successfully Jul 08 02:40:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc47cf51-8c14-4bbf-ae6f-39f365798b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Flow 'volume_create_manager' (365296ec-e8d0-4298-b7ed-2bf88d3879a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:09 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d5946f-0368-4ac4-b65e-544eb21ffe0e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:09 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-98317bda-da9b-4a59-8688-d193a9f11aa5 tempest-VolumesTestJSON-322266156 None] Created volume successfully. Jul 08 02:40:09 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 Jul 08 02:40:09 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:10 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170" returned: 1 in 0.838s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Downloaded image 9d652479-1a49-4785-9fa6-62d5f48b409f ((None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}])) to volume 9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 successfully. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Temporary image 9d652479-1a49-4785-9fa6-62d5f48b409f for user efb892529801434ba5cbd0c16fa1ea33 is deleted. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Marking volume 9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 as bootable. {{(pid=87238) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Copying metadata from image 9d652479-1a49-4785-9fa6-62d5f48b409f to 9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170. {{(pid=87238) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Creating volume glance metadata for volume 9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 backed by image 9d652479-1a49-4785-9fa6-62d5f48b409f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87238) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95e97c4-b9f7-4971-86bb-09476f52c3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170', 'volume_size': 1, 'image_id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a21b7084cd94a8dbdfabbb9ed31db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'created_at': datetime.datetime(2026, 7, 8, 0, 29, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 29, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d652479-1a49-4785-9fa6-62d5f48b409f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f917bc9b-043f-484a-bdf3-6c156403322c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:10 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Volume volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 (9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170): created successfully Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f917bc9b-043f-484a-bdf3-6c156403322c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Flow 'volume_create_manager' (3b40267f-9280-472a-846c-82b747c55716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:10 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-4e5456bc-e103-411d-a9ad-9fe6c1a08d58 tempest-VolumesImageMetadata-823284473 None] Created volume successfully. Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Flow 'volume_create_manager' (76a93945-6aab-4738-ad5b-39b4bc86c761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b9030a-61b2-4b5e-9577-443c09cbace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b9030a-61b2-4b5e-9577-443c09cbace7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1636457438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20de045f-7057-40c5-a105-a8dfb2ee18b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eba45770b836473485467dc3f50ea08e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:40:10Z,use_quota=True,user_id='999deb63d36a45f89fe49a7ca3b6fc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787360ba-151b-40ee-b1f8-1495fdc84b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787360ba-151b-40ee-b1f8-1495fdc84b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4153f8cb-f8c7-4737-8b2c-3baee34a9704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4153f8cb-f8c7-4737-8b2c-3baee34a9704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20de045f-7057-40c5-a105-a8dfb2ee18b1', 'volume_name': 'volume-20de045f-7057-40c5-a105-a8dfb2ee18b1', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d98205b-4a03-402e-b739-6bbe5c29cd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d98205b-4a03-402e-b739-6bbe5c29cd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f282ad93-6c5e-4f68-b438-0b2bd58c078b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:10 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Volume 20de045f-7057-40c5-a105-a8dfb2ee18b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20de045f-7057-40c5-a105-a8dfb2ee18b1', 'volume_size': 1} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:10 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93" returned: 0 in 0.936s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:10 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 1G Jul 08 02:40:10 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Acquiring lock "cinder-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Lock "cinder-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Acquiring lock "cinder-quobyte-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Lock "cinder-quobyte-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170" acquired by "delete_volume" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:11 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da4d8ad-ca03-460d-a623-141aeb0a218a]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:11 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 Jul 08 02:40:11 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:11 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 1G" returned: 0 in 0.948s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-512251a0-f58d-4c4f-b184-d9644b148e93 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:11 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-512251a0-f58d-4c4f-b184-d9644b148e93 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 Jul 08 02:40:11 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:11 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170" returned: 0 in 0.838s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:12 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 Jul 08 02:40:12 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:12 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-512251a0-f58d-4c4f-b184-d9644b148e93 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32" returned: 0 in 0.775s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:12 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 02:40:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:12 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 Jul 08 02:40:12 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:12 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170" returned: 1 in 0.875s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:40:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:12 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170 Jul 08 02:40:12 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:13 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32" returned: 0 in 0.701s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:13 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.info Jul 08 02:40:13 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:13 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170" returned: 0 in 0.692s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Lock "cinder-quobyte-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170" released by "delete_volume" :: held 2.489s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:13 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Created reservations ['26a90099-6de0-4d48-9587-5098cecba69b', '80300553-9a87-4f8c-a4cb-b5654a1d0266', 'e5eb540a-0c68-453e-917b-332d5eddcb41', '14bbb848-5b59-4a8d-b7c6-6a9cc2e7e980'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:40:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:13 devstack sudo[93124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:40:13 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:13 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.info" returned: 0 in 0.743s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:13 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 02:40:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:13 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.info Jul 08 02:40:13 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:14 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.info" returned: 0 in 0.732s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:14 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.017s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.160s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1636457438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20de045f-7057-40c5-a105-a8dfb2ee18b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eba45770b836473485467dc3f50ea08e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:40:10Z,use_quota=True,user_id='999deb63d36a45f89fe49a7ca3b6fc93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:40:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Creating volume 20de045f-7057-40c5-a105-a8dfb2ee18b1 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:40:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:40:14 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:40:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-20de045f-7057-40c5-a105-a8dfb2ee18b1 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.862s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:14 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:40:14 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-20de045f-7057-40c5-a105-a8dfb2ee18b1 1073741824 Jul 08 02:40:14 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:14 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Deleted volume successfully. Jul 08 02:40:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8b75d5d7-702a-4918-bcca-0b1d1a9ae8f2 tempest-VolumesImageMetadata-823284473 None] Lock "cinder-9e7b8d6c-51ee-4e62-a5cd-ea32b7d8f170-delete_volume" released by "delete_volume" :: held 3.645s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:14 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5442daaa-bdf3-4567-bf47-e676770126a1 tempest-GroupSnapshotsTest-910327665 None] group_snapshot 7dc072b9-3228-4269-8ed1-988f5876d40b: created successfully Jul 08 02:40:15 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-20de045f-7057-40c5-a105-a8dfb2ee18b1 1073741824" returned: 0 in 1.197s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-20de045f-7057-40c5-a105-a8dfb2ee18b1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:15 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-20de045f-7057-40c5-a105-a8dfb2ee18b1 Jul 08 02:40:15 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:16 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-20de045f-7057-40c5-a105-a8dfb2ee18b1" returned: 0 in 0.833s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.321s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "cinder-quobyte-c9a7c121-f022-4955-a6c3-889a534f2c32-19d2a960-c265-43f6-830e-90891311d81e" by "_create_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f282ad93-6c5e-4f68-b438-0b2bd58c078b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20de045f-7057-40c5-a105-a8dfb2ee18b1', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e141f452-0a2a-417c-953b-086b6290165f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-c9a7c121-f022-4955-a6c3-889a534f2c32-19d2a960-c265-43f6-830e-90891311d81e" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Creating volume 19d2a960-c265-43f6-830e-90891311d81e from snapshot c9a7c121-f022-4955-a6c3-889a534f2c32 {{(pid=87238) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "cinder-quobyte-19d2a960-c265-43f6-830e-90891311d81e" by "_copy_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:16 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Volume volume-20de045f-7057-40c5-a105-a8dfb2ee18b1 (20de045f-7057-40c5-a105-a8dfb2ee18b1): created successfully Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e141f452-0a2a-417c-953b-086b6290165f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Flow 'volume_create_manager' (76a93945-6aab-4738-ad5b-39b4bc86c761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-19d2a960-c265-43f6-830e-90891311d81e" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] snapshot: c9a7c121-f022-4955-a6c3-889a534f2c32, volume: 19d2a960-c265-43f6-830e-90891311d81e, {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:16 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-972f1ac4-e0df-4d24-a1a7-c2098fa305c9 tempest-VolumesTestJSON-322266156 None] Created volume successfully. Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b8635a-6afd-4339-a40b-6b7b69c277d7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:16 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 Jul 08 02:40:16 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:17 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32" returned: 0 in 0.930s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-512251a0-f58d-4c4f-b184-d9644b148e93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:40:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 02:40:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Creating direct copy from snapshot {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 02:40:17 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[007352be-385b-43f7-aebb-7ff5aecf2ea7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:17 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 Jul 08 02:40:17 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:18 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:40:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Flow 'volume_create_manager' (04ecf25e-0192-4f20-8bc7-4fd37736b1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50e5aff-7000-4aba-b682-652eb5f358e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50e5aff-7000-4aba-b682-652eb5f358e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-227731062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c0d8da-5dcf-470f-bd4c-285ced941d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d6de94d3034f55a0a0c3c5fedecc62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:40:19Z,use_quota=True,user_id='0f21d7d0a4aa483b84884ccfc3f3cc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968fc541-f369-4f28-9c75-cc30b829ad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968fc541-f369-4f28-9c75-cc30b829ad4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343acfa7-71e3-4cf0-bcd1-274d92ae5e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343acfa7-71e3-4cf0-bcd1-274d92ae5e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c0d8da-5dcf-470f-bd4c-285ced941d1b', 'volume_name': 'volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c658f11d-1903-488a-8970-e39d810a8810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c658f11d-1903-488a-8970-e39d810a8810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e81128-8edc-429a-befd-c5bd7d1dac06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:18 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Volume 89c0d8da-5dcf-470f-bd4c-285ced941d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b', 'volume_size': 1} Jul 08 02:40:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:18 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93" returned: 0 in 1.129s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:18 devstack cinder-volume[87238]: DEBUG cinder.utils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Path /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-19d2a960-c265-43f6-830e-90891311d81e not found in is_blk_device check {{(pid=87238) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 02:40:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-19d2a960-c265-43f6-830e-90891311d81e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:18 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-19d2a960-c265-43f6-830e-90891311d81e Jul 08 02:40:18 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Acquiring lock "cinder-20de045f-7057-40c5-a105-a8dfb2ee18b1-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Lock "cinder-20de045f-7057-40c5-a105-a8dfb2ee18b1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Acquiring lock "cinder-quobyte-20de045f-7057-40c5-a105-a8dfb2ee18b1" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Lock "cinder-quobyte-20de045f-7057-40c5-a105-a8dfb2ee18b1" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:19 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f42992f-1abc-48c3-8dc4-af5563593bba]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-20de045f-7057-40c5-a105-a8dfb2ee18b1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:19 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-20de045f-7057-40c5-a105-a8dfb2ee18b1 Jul 08 02:40:19 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:21 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-20de045f-7057-40c5-a105-a8dfb2ee18b1" returned: 0 in 1.951s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-20de045f-7057-40c5-a105-a8dfb2ee18b1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:21 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-20de045f-7057-40c5-a105-a8dfb2ee18b1 Jul 08 02:40:21 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:23 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-20de045f-7057-40c5-a105-a8dfb2ee18b1" returned: 0 in 1.392s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Lock "cinder-quobyte-20de045f-7057-40c5-a105-a8dfb2ee18b1" released by "delete_volume" :: held 3.401s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:23 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Created reservations ['714c7a93-9c7e-4185-8beb-71f1408e287b', '7f327c61-ceec-40cc-b52a-7a0b12b5e06f', 'ccd72f79-33b0-483f-bbfa-538a912bf458', 'a938a941-80a5-4025-97aa-b208f96db81a'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:40:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:23 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:40:23 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Acquiring lock "cinder-49646f2d-6971-4a33-b4ff-9cd32c291555-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:24 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Lock "cinder-49646f2d-6971-4a33-b4ff-9cd32c291555-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.235s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:24 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:40:24 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Deleted volume successfully. Jul 08 02:40:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7a7c9d9a-b342-4a7e-a466-966e476af23b tempest-VolumesTestJSON-322266156 None] Lock "cinder-20de045f-7057-40c5-a105-a8dfb2ee18b1-delete_volume" released by "delete_volume" :: held 5.139s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Acquiring lock "cinder-quobyte-49646f2d-6971-4a33-b4ff-9cd32c291555" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Lock "cinder-quobyte-49646f2d-6971-4a33-b4ff-9cd32c291555" acquired by "delete_volume" :: waited 0.063s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:24 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbf3bdf-7c60-4638-8868-a33472694014]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-49646f2d-6971-4a33-b4ff-9cd32c291555 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:25 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-49646f2d-6971-4a33-b4ff-9cd32c291555 Jul 08 02:40:25 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:25 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-19d2a960-c265-43f6-830e-90891311d81e" returned: 0 in 6.354s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:25 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c348256-44cf-414e-bbab-51787e88abd7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:25 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 Jul 08 02:40:25 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:25 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-49646f2d-6971-4a33-b4ff-9cd32c291555" returned: 0 in 0.896s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-49646f2d-6971-4a33-b4ff-9cd32c291555 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:25 devstack sudo[93233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-49646f2d-6971-4a33-b4ff-9cd32c291555 Jul 08 02:40:25 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:26 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93" returned: 0 in 1.081s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:26 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-19d2a960-c265-43f6-830e-90891311d81e {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:40:26 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Converted 1024.00 MB image at 161.09 MB/s Jul 08 02:40:26 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-19d2a960-c265-43f6-830e-90891311d81e is being set with open permissions: ugo+rw: NotImplementedError Jul 08 02:40:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-19d2a960-c265-43f6-830e-90891311d81e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:26 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-19d2a960-c265-43f6-830e-90891311d81e Jul 08 02:40:26 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:26 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-49646f2d-6971-4a33-b4ff-9cd32c291555" returned: 0 in 0.790s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Lock "cinder-quobyte-49646f2d-6971-4a33-b4ff-9cd32c291555" released by "delete_volume" :: held 1.787s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:26 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Created reservations ['6831241a-00a2-4448-a4d5-ccbe0c3fa6d0', 'f2d6668b-7269-4b39-939f-c665f34dfa1a', '4f4c425f-c58d-4a1f-bc4e-f39cb9e63600', '47bfe8fe-818e-473f-b74f-68f7184c2c8d'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:40:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:26 devstack sudo[93242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:40:26 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Acquiring lock "cinder-d7f0687e-27d9-4fea-941a-4d31df04a60e-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Lock "cinder-d7f0687e-27d9-4fea-941a-4d31df04a60e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Acquiring lock "cinder-quobyte-d7f0687e-27d9-4fea-941a-4d31df04a60e" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Lock "cinder-quobyte-d7f0687e-27d9-4fea-941a-4d31df04a60e" acquired by "delete_volume" :: waited 0.030s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[5959c5bd-d1dd-4a71-8e38-4118683429d8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d7f0687e-27d9-4fea-941a-4d31df04a60e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:27 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-19d2a960-c265-43f6-830e-90891311d81e" returned: 0 in 0.946s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-19d2a960-c265-43f6-830e-90891311d81e" released by "_copy_volume_from_snapshot" :: held 10.571s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-c9a7c121-f022-4955-a6c3-889a534f2c32-19d2a960-c265-43f6-830e-90891311d81e" released by "_create_volume_from_snapshot" :: held 10.629s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.672s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.506s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-227731062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c0d8da-5dcf-470f-bd4c-285ced941d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d6de94d3034f55a0a0c3c5fedecc62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:40:19Z,use_quota=True,user_id='0f21d7d0a4aa483b84884ccfc3f3cc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Creating volume 89c0d8da-5dcf-470f-bd4c-285ced941d1b {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:40:27 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:27 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b 1073741824 Jul 08 02:40:27 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:27 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d7f0687e-27d9-4fea-941a-4d31df04a60e Jul 08 02:40:27 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:27 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-62e59d94-3853-46fe-88e1-d4e21b671f6a tempest-GroupSnapshotsTest-910327665 None] Create group from source-snapshot-7dc072b9-3228-4269-8ed1-988f5876d40b completed successfully. Jul 08 02:40:27 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.957s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:40:27 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Deleted volume successfully. Jul 08 02:40:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d0495e0-42b3-4268-9eed-0212ee0a37ae tempest-VolumesTestJSON-322266156 None] Lock "cinder-49646f2d-6971-4a33-b4ff-9cd32c291555-delete_volume" released by "delete_volume" :: held 3.170s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:28 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d7f0687e-27d9-4fea-941a-4d31df04a60e" returned: 0 in 1.129s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d7f0687e-27d9-4fea-941a-4d31df04a60e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:28 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d7f0687e-27d9-4fea-941a-4d31df04a60e Jul 08 02:40:28 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "cinder-quobyte-19d2a960-c265-43f6-830e-90891311d81e" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-19d2a960-c265-43f6-830e-90891311d81e" acquired by "delete_volume" :: waited 0.043s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:28 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c81c0d-374d-4d25-a7e0-ff388d1cf203]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-19d2a960-c265-43f6-830e-90891311d81e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:28 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b 1073741824" returned: 0 in 1.586s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:29 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b Jul 08 02:40:29 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:29 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-19d2a960-c265-43f6-830e-90891311d81e Jul 08 02:40:29 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:29 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d7f0687e-27d9-4fea-941a-4d31df04a60e" returned: 0 in 0.916s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Lock "cinder-quobyte-d7f0687e-27d9-4fea-941a-4d31df04a60e" released by "delete_volume" :: held 2.136s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:29 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Created reservations ['b9f2bb8e-40ff-425c-8561-b775874d801c', 'ced68c82-f020-4ba9-b6ff-61330b37e766', 'ffb8cae9-3fc4-4fa7-866b-cf7be06ee62b', 'e4110804-8a4e-4c91-b3e8-c78dda6798f1'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:40:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:29 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:40:29 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:30 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b" returned: 0 in 0.991s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] <== create_volume: return (2639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.649s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e81128-8edc-429a-befd-c5bd7d1dac06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caac5c6-0458-4eb0-807b-f9191a379c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:30 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Volume volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b (89c0d8da-5dcf-470f-bd4c-285ced941d1b): created successfully Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caac5c6-0458-4eb0-807b-f9191a379c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Flow 'volume_create_manager' (04ecf25e-0192-4f20-8bc7-4fd37736b1dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:30 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a6135827-621e-4f21-a716-3d4ea55843cd tempest-SnapshotMetadataTestJSON-948147776 None] Created volume successfully. Jul 08 02:40:30 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-19d2a960-c265-43f6-830e-90891311d81e" returned: 0 in 1.338s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-19d2a960-c265-43f6-830e-90891311d81e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:30 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-19d2a960-c265-43f6-830e-90891311d81e Jul 08 02:40:30 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:30 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.862s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:40:30 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Deleted volume successfully. Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-beaf12f2-ec84-43a0-bee3-49e96c31e2c7 tempest-VolumesTestJSON-322266156 None] Lock "cinder-d7f0687e-27d9-4fea-941a-4d31df04a60e-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] Creating offline snapshot 02031bda-486b-41e1-9d6b-7b038faa05d7 of volume 89c0d8da-5dcf-470f-bd4c-285ced941d1b {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bebd87-1514-44eb-b564-c8211926ff4a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:31 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b Jul 08 02:40:31 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:31 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-19d2a960-c265-43f6-830e-90891311d81e" returned: 0 in 0.868s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:31 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-19d2a960-c265-43f6-830e-90891311d81e" released by "delete_volume" :: held 2.286s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:31 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Created reservations ['7461bd31-6c22-45f0-9640-90f63ae3e9e0'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:40:31 devstack cinder-volume[87238]: WARNING cinder.quota [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-451945209 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-451945209, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:40:31 devstack cinder-volume[87238]: WARNING cinder.quota [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-451945209 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-451945209, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:40:31 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Created reservations ['bf66ecf7-0002-437e-a1da-69c515970106', '40e89e48-8036-4c32-b5b7-c6e86576afbb', '19b6fd7a-ce63-487a-835f-3c7346453e10', '309cdf4b-381c-41d8-898d-fea56dc0b3a8'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:40:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:31 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:40:31 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:32 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b" returned: 0 in 1.151s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:32 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7 1G Jul 08 02:40:32 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:32 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.956s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:32 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:40:32 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e4b65635-65b9-48d8-94a7-638607839b92 tempest-GroupSnapshotsTest-910327665 None] Delete group completed successfully. Jul 08 02:40:32 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] group_snapshot 7dc072b9-3228-4269-8ed1-988f5876d40b: deleting Jul 08 02:40:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] group_snapshot 7dc072b9-3228-4269-8ed1-988f5876d40b: deleting {{(pid=87238) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 02:40:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "cinder-quobyte-512251a0-f58d-4c4f-b184-d9644b148e93" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-512251a0-f58d-4c4f-b184-d9644b148e93" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "cinder-quobyte-c9a7c121-f022-4955-a6c3-889a534f2c32" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-c9a7c121-f022-4955-a6c3-889a534f2c32" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] Deleting offline snapshot c9a7c121-f022-4955-a6c3-889a534f2c32 of volume 512251a0-f58d-4c4f-b184-d9644b148e93 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:40:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] snapshot_file for this snap is: volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:40:32 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1436ba25-dcb9-469e-b78c-f27f1272c3bd]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:32 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 Jul 08 02:40:32 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:33 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7 1G" returned: 0 in 1.155s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:33 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7 Jul 08 02:40:33 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:33 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32" returned: 0 in 0.904s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-512251a0-f58d-4c4f-b184-d9644b148e93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:40:33 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc62e1c1-53cd-40de-94fc-82c783ad784c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:33 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 Jul 08 02:40:33 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:34 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7" returned: 0 in 0.953s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:34 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7 is being set with open permissions: ugo+rw Jul 08 02:40:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:34 devstack sudo[93311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7 Jul 08 02:40:34 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:34 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93" returned: 0 in 1.101s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:34 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 Jul 08 02:40:34 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:35 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7" returned: 0 in 0.856s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:35 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.info Jul 08 02:40:35 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:35 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32" returned: 0 in 1.070s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:35 devstack sudo[93332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32 Jul 08 02:40:35 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:35 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.info" returned: 0 in 0.870s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:35 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.info is being set with open permissions: ugo+rw Jul 08 02:40:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:36 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.info Jul 08 02:40:36 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:36 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4072468e-1d2e-466a-85f9-f304fb95478a tempest-BackendsCapabilitiesAdminTestsJSON-903818219 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.710319519043, 'free_capacity_gb': 1775.710319519043, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87238) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 02:40:36 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93.c9a7c121-f022-4955-a6c3-889a534f2c32" returned: 0 in 0.715s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-c9a7c121-f022-4955-a6c3-889a534f2c32" released by "_delete_snapshot" :: held 3.911s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-512251a0-f58d-4c4f-b184-d9644b148e93" released by "delete_snapshot" :: held 3.945s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:36 devstack cinder-volume[87238]: WARNING cinder.quota [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-451945209 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-451945209, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:40:36 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.info" returned: 0 in 0.787s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.909s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:36 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] Created reservations ['d0c012c3-dfbf-44d5-80ee-d774f86fe6d3', '78abe201-fa38-481d-8492-20eab89f7a25', '43fe3004-cb2a-496c-a65c-10a1de6e9769', 'bf00b9bc-9eaa-448b-81d0-25269e2fd19f'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:40:36 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-34987bf3-d3bc-4262-be04-b2df037ea125 tempest-SnapshotMetadataTestJSON-948147776 None] Create snapshot completed successfully Jul 08 02:40:36 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-144ec098-480e-4ee1-ab9b-60be5b73d095 tempest-GroupSnapshotsTest-910327665 None] group_snapshot 7dc072b9-3228-4269-8ed1-988f5876d40b: deleted successfully Jul 08 02:40:36 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e1aec6bb-c87f-4ec6-bdf1-e9a8db081368 tempest-BackendsCapabilitiesAdminTestsJSON-903818219 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.710319519043, 'free_capacity_gb': 1775.710319519043, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87238) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 02:40:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "cinder-quobyte-512251a0-f58d-4c4f-b184-d9644b148e93" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-512251a0-f58d-4c4f-b184-d9644b148e93" acquired by "delete_volume" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:37 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[b437fc8e-7e08-4cf9-a58f-99c39904878f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:37 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 Jul 08 02:40:37 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Acquiring lock "cinder-02031bda-486b-41e1-9d6b-7b038faa05d7-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Lock "cinder-02031bda-486b-41e1-9d6b-7b038faa05d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Acquiring lock "cinder-quobyte-89c0d8da-5dcf-470f-bd4c-285ced941d1b" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Lock "cinder-quobyte-89c0d8da-5dcf-470f-bd4c-285ced941d1b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Acquiring lock "cinder-quobyte-02031bda-486b-41e1-9d6b-7b038faa05d7" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Lock "cinder-quobyte-02031bda-486b-41e1-9d6b-7b038faa05d7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Deleting offline snapshot 02031bda-486b-41e1-9d6b-7b038faa05d7 of volume 89c0d8da-5dcf-470f-bd4c-285ced941d1b {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:40:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] snapshot_file for this snap is: volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:40:38 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aae5b71-3287-4000-906d-68f125897133]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:38 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7 Jul 08 02:40:38 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:38 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93" returned: 0 in 1.016s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:38 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93 Jul 08 02:40:38 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:39 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7" returned: 0 in 0.893s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:40:39 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e3d273-f95f-476a-8ae3-f017e082c4ab]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:39 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-512251a0-f58d-4c4f-b184-d9644b148e93" returned: 0 in 0.807s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-512251a0-f58d-4c4f-b184-d9644b148e93" released by "delete_volume" :: held 1.926s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:39 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b Jul 08 02:40:39 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:39 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] Created reservations ['c18eff07-c77a-4b23-9f5b-8b47fb71ec9c'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:40:39 devstack cinder-volume[87238]: WARNING cinder.db.api [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-451945209'] Jul 08 02:40:39 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] Created reservations ['4181ddee-82f5-4d35-829b-4485ea192aab', '3e657bc0-06de-44d3-af6a-ce30601a785b', '49dd36e9-0ad4-495f-846d-6d07505d5247', 'f2ff667f-03af-42ec-867a-1af7370e7af9'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:40:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:39 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:40:39 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:40 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b" returned: 0 in 1.351s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:40 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2c096199-ab51-4174-8132-ebe12fb5f2f8 tempest-GroupSnapshotsTest-910327665 None] Group tempest-GroupSnapshotsTest-Group-1253451317: creating Jul 08 02:40:40 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7 Jul 08 02:40:40 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:40 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2c096199-ab51-4174-8132-ebe12fb5f2f8 tempest-GroupSnapshotsTest-910327665 None] Group tempest-GroupSnapshotsTest-Group-1253451317: created successfully Jul 08 02:40:40 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2c096199-ab51-4174-8132-ebe12fb5f2f8 tempest-GroupSnapshotsTest-910327665 None] Create group completed successfully. Jul 08 02:40:40 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.199s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:40 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:40:40 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-be98cd96-9fd1-49ae-81e7-df19b4bdc660 tempest-GroupSnapshotsTest-910327665 None] Delete group completed successfully. Jul 08 02:40:41 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7" returned: 0 in 1.068s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:41 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7 Jul 08 02:40:41 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Flow 'volume_create_manager' (f33efe5b-c797-4609-ab0e-8368c7706a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c002ebe5-f072-4c3f-9e12-3d1d8e9d20ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c002ebe5-f072-4c3f-9e12-3d1d8e9d20ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-958660872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42672be3-61f5-4d7d-89f8-96bcd9430e8e,host='devstack@QuobyteHD#QuobyteHD',id=7dfcadac-ebaf-4f19-b317-2b0b30288f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323f0bb16974456ca1b52bf702ba40a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:40:43Z,use_quota=True,user_id='fba714f94dcb4e55ab174ee5da641c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a09d5b7-8d7b-47e6-ab76-04c174bf8720),volume_type_id=6a09d5b7-8d7b-47e6-ab76-04c174bf8720)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54720d2d-2b34-4123-bb53-ccafafe26d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54720d2d-2b34-4123-bb53-ccafafe26d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf012c40-5a50-4189-96c7-a3b444501dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf012c40-5a50-4189-96c7-a3b444501dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dfcadac-ebaf-4f19-b317-2b0b30288f4c', 'volume_name': 'volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ac5769-e208-4a40-9830-98cda56b21f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ac5769-e208-4a40-9830-98cda56b21f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75039ffa-d606-4b42-9d1c-57b59ce4c0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:42 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Volume 7dfcadac-ebaf-4f19-b317-2b0b30288f4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c', 'volume_size': 1} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=42672be3-61f5-4d7d-89f8-96bcd9430e8e,created_at=2026-07-08T00:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-958660872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42672be3-61f5-4d7d-89f8-96bcd9430e8e,host='devstack@QuobyteHD#QuobyteHD',id=7dfcadac-ebaf-4f19-b317-2b0b30288f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323f0bb16974456ca1b52bf702ba40a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:40:43Z,use_quota=True,user_id='fba714f94dcb4e55ab174ee5da641c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a09d5b7-8d7b-47e6-ab76-04c174bf8720),volume_type_id=6a09d5b7-8d7b-47e6-ab76-04c174bf8720)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Creating volume 7dfcadac-ebaf-4f19-b317-2b0b30288f4c {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:40:42 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:42 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b.02031bda-486b-41e1-9d6b-7b038faa05d7" returned: 0 in 1.150s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:42 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c 1073741824 Jul 08 02:40:42 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Lock "cinder-quobyte-02031bda-486b-41e1-9d6b-7b038faa05d7" released by "_delete_snapshot" :: held 4.639s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Lock "cinder-quobyte-89c0d8da-5dcf-470f-bd4c-285ced941d1b" released by "delete_snapshot" :: held 4.673s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:43 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Created reservations ['d72ad6e8-e9e2-4edc-a275-592d7521c563', '5d04743f-a728-4a82-b825-4ea55f551cfc', 'a4f71ada-1909-48b1-82d5-c686b815d71e', 'd800889c-69fa-4789-929a-48deb9b49f91'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:40:43 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Delete snapshot completed successfully. Jul 08 02:40:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0891138e-2c3c-4237-9e70-d193e6db02d1 tempest-SnapshotMetadataTestJSON-948147776 None] Lock "cinder-02031bda-486b-41e1-9d6b-7b038faa05d7-delete_snapshot" released by "delete_snapshot" :: held 4.888s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Acquiring lock "cinder-89c0d8da-5dcf-470f-bd4c-285ced941d1b-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Lock "cinder-89c0d8da-5dcf-470f-bd4c-285ced941d1b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:43 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=118,cinder:INSERT=38,cinder:UPDATE=126,cinder:DELETE=7 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:40:43 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=108,cinder:INSERT=37,cinder:UPDATE=138,cinder:DELETE=9 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:40:44 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Acquiring lock "cinder-quobyte-89c0d8da-5dcf-470f-bd4c-285ced941d1b" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:40:44 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Lock "cinder-quobyte-89c0d8da-5dcf-470f-bd4c-285ced941d1b" acquired by "delete_volume" :: waited 0.035s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:40:44 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdef97a-938a-4a41-bb05-6c177108a454]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:44 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b Jul 08 02:40:44 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:44 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c 1073741824" returned: 0 in 1.653s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:44 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c Jul 08 02:40:44 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:45 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5fa75a63-30a5-4524-a22f-6ed46a17cd23 tempest-GroupSnapshotsV319Test-118900537 None] Group tempest-GroupSnapshotsV319Test-Group-1846911648: creating Jul 08 02:40:45 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5fa75a63-30a5-4524-a22f-6ed46a17cd23 tempest-GroupSnapshotsV319Test-118900537 None] Group tempest-GroupSnapshotsV319Test-Group-1846911648: created successfully Jul 08 02:40:45 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5fa75a63-30a5-4524-a22f-6ed46a17cd23 tempest-GroupSnapshotsV319Test-118900537 None] Create group completed successfully. Jul 08 02:40:45 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b" returned: 0 in 1.428s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:45 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b Jul 08 02:40:45 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:45 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c" returned: 0 in 1.025s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] <== create_volume: return (2774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:40:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.780s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75039ffa-d606-4b42-9d1c-57b59ce4c0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b12a61-a411-4771-8e5c-8a7475caad48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:45 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Volume volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c (7dfcadac-ebaf-4f19-b317-2b0b30288f4c): created successfully Jul 08 02:40:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b12a61-a411-4771-8e5c-8a7475caad48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Flow 'volume_create_manager' (f33efe5b-c797-4609-ab0e-8368c7706a1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:45 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e1d3f897-033b-43c7-84d8-30ee80dab476 tempest-GroupSnapshotsTest-910327665 None] Created volume successfully. Jul 08 02:40:46 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89c0d8da-5dcf-470f-bd4c-285ced941d1b" returned: 0 in 0.720s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Lock "cinder-quobyte-89c0d8da-5dcf-470f-bd4c-285ced941d1b" released by "delete_volume" :: held 2.249s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:46 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Created reservations ['6290efe5-1a30-42a0-baf7-1a66fde8b956', '55c15286-7390-4dad-a573-1562a036adfc', '9746ff14-3748-4a8a-9daf-9c61942a95f2', '4ae6cf28-d9d2-48cf-a192-45d81bf7b449'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:40:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:46 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:46 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:46 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:40:46 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:46 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Flow 'volume_create_manager' (0cf550ff-3616-4831-9ee5-efc2f65dd950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04d4be0-bde6-472b-a84d-7253916511ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04d4be0-bde6-472b-a84d-7253916511ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1931418451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=12ba42d7-ab8e-42f8-a6c0-2dceccaa3a76,host='devstack@QuobyteHD#QuobyteHD',id=44578b3d-4bd3-4d88-8baa-604df79242fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26e70f5b679420e831939b8a0d92b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:40:47Z,use_quota=True,user_id='0b543b1f9b924b25a1dba0c49ee2cbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9f4e782-8df4-4a2f-89ca-d8aa04969fe1),volume_type_id=c9f4e782-8df4-4a2f-89ca-d8aa04969fe1)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a1a1d0-2278-491d-b0d1-010cb8b1fd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a1a1d0-2278-491d-b0d1-010cb8b1fd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25541b89-8b0c-4444-a18e-9dc26e78a72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25541b89-8b0c-4444-a18e-9dc26e78a72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44578b3d-4bd3-4d88-8baa-604df79242fd', 'volume_name': 'volume-44578b3d-4bd3-4d88-8baa-604df79242fd', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2815b6b9-b2ee-42fc-a60d-035b01b100c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2815b6b9-b2ee-42fc-a60d-035b01b100c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1adf7f3-53d8-495d-9327-85a1576a2c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:47 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Volume 44578b3d-4bd3-4d88-8baa-604df79242fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44578b3d-4bd3-4d88-8baa-604df79242fd', 'volume_size': 1} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=12ba42d7-ab8e-42f8-a6c0-2dceccaa3a76,created_at=2026-07-08T00:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1931418451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=12ba42d7-ab8e-42f8-a6c0-2dceccaa3a76,host='devstack@QuobyteHD#QuobyteHD',id=44578b3d-4bd3-4d88-8baa-604df79242fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26e70f5b679420e831939b8a0d92b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:40:47Z,use_quota=True,user_id='0b543b1f9b924b25a1dba0c49ee2cbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9f4e782-8df4-4a2f-89ca-d8aa04969fe1),volume_type_id=c9f4e782-8df4-4a2f-89ca-d8aa04969fe1)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Creating volume 44578b3d-4bd3-4d88-8baa-604df79242fd {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:40:47 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:47 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd 1073741824 Jul 08 02:40:47 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:47 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:40:47 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:47 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.257s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:40:47 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Deleted volume successfully. Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d7841baa-61a9-4af9-abbd-3b0eb5228545 tempest-SnapshotMetadataTestJSON-948147776 None] Lock "cinder-89c0d8da-5dcf-470f-bd4c-285ced941d1b-delete_volume" released by "delete_volume" :: held 3.947s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Flow 'volume_create_manager' (6927bc05-3b0d-401f-a319-bfc9a8151c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab817a42-be3e-4c15-98a9-c3c1408d27bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab817a42-be3e-4c15-98a9-c3c1408d27bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-390987281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42672be3-61f5-4d7d-89f8-96bcd9430e8e,host='devstack@QuobyteHD#QuobyteHD',id=cfd00a96-bfa3-490b-b06e-51419502a199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323f0bb16974456ca1b52bf702ba40a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:40:48Z,use_quota=True,user_id='fba714f94dcb4e55ab174ee5da641c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a09d5b7-8d7b-47e6-ab76-04c174bf8720),volume_type_id=6a09d5b7-8d7b-47e6-ab76-04c174bf8720)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77dbb355-8a80-4454-b342-5bd8cf527e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77dbb355-8a80-4454-b342-5bd8cf527e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bccdb5d-1068-43bd-a679-0afc21d63117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bccdb5d-1068-43bd-a679-0afc21d63117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfd00a96-bfa3-490b-b06e-51419502a199', 'volume_name': 'volume-cfd00a96-bfa3-490b-b06e-51419502a199', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a05d22a-955a-4f49-a097-169e88d76380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a05d22a-955a-4f49-a097-169e88d76380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce3e5b1-f6a9-4c22-bea1-70ee057b15e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:48 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Volume cfd00a96-bfa3-490b-b06e-51419502a199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfd00a96-bfa3-490b-b06e-51419502a199', 'volume_size': 1} Jul 08 02:40:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:48 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd 1073741824" returned: 0 in 1.358s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:48 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd Jul 08 02:40:48 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:48 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.510s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:40:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:40:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 28 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:40:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:40:49 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd" returned: 0 in 0.855s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] <== create_volume: return (2289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.295s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.356s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=42672be3-61f5-4d7d-89f8-96bcd9430e8e,created_at=2026-07-08T00:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-390987281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42672be3-61f5-4d7d-89f8-96bcd9430e8e,host='devstack@QuobyteHD#QuobyteHD',id=cfd00a96-bfa3-490b-b06e-51419502a199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323f0bb16974456ca1b52bf702ba40a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:40:48Z,use_quota=True,user_id='fba714f94dcb4e55ab174ee5da641c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a09d5b7-8d7b-47e6-ab76-04c174bf8720),volume_type_id=6a09d5b7-8d7b-47e6-ab76-04c174bf8720)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Creating volume cfd00a96-bfa3-490b-b06e-51419502a199 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:40:49 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1adf7f3-53d8-495d-9327-85a1576a2c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44578b3d-4bd3-4d88-8baa-604df79242fd', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:49 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199 1073741824 Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f1fba6-2cb1-4a8a-9456-0de4cbadc97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:49 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:49 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Volume volume-44578b3d-4bd3-4d88-8baa-604df79242fd (44578b3d-4bd3-4d88-8baa-604df79242fd): created successfully Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f1fba6-2cb1-4a8a-9456-0de4cbadc97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Flow 'volume_create_manager' (0cf550ff-3616-4831-9ee5-efc2f65dd950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:49 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3f3482b8-705d-4d89-8c3b-36cc4afa29fe tempest-GroupSnapshotsV319Test-118900537 None] Created volume successfully. Jul 08 02:40:51 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199 1073741824" returned: 0 in 1.682s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:51 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199 Jul 08 02:40:51 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:51 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] GroupSnapshot 9670305b-c20a-4c3d-b5cb-12645a9a11a7: creating. Jul 08 02:40:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] Group snapshot 9670305b-c20a-4c3d-b5cb-12645a9a11a7: creating. {{(pid=87238) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 02:40:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:52 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199" returned: 0 in 1.096s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] <== create_volume: return (2884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:40:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.887s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.927s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] Creating offline snapshot 39210f8c-0c33-405e-ad0c-63edef6fb101 of volume 44578b3d-4bd3-4d88-8baa-604df79242fd {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:40:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce3e5b1-f6a9-4c22-bea1-70ee057b15e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfd00a96-bfa3-490b-b06e-51419502a199', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7fd047-237c-4648-b433-8f582c344655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:52 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8545e62-adf7-4509-92c4-9e90c57079e9]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:40:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:52 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Volume volume-cfd00a96-bfa3-490b-b06e-51419502a199 (cfd00a96-bfa3-490b-b06e-51419502a199): created successfully Jul 08 02:40:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7fd047-237c-4648-b433-8f582c344655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Flow 'volume_create_manager' (6927bc05-3b0d-401f-a319-bfc9a8151c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:52 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-4832a9de-25f6-49f2-871c-2ff21b8b329e tempest-GroupSnapshotsTest-910327665 None] Created volume successfully. Jul 08 02:40:52 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd Jul 08 02:40:52 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:53 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b4ffe76a-e624-4be3-9fb9-43362a3ffb48 tempest-GroupSnapshotsTest-910327665 None] Update group completed successfully. Jul 08 02:40:53 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd" returned: 0 in 1.292s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:53 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101 1G Jul 08 02:40:53 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:54 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-861ac682-9c27-4a47-90ea-2720d3c5426d tempest-GroupSnapshotsTest-910327665 None] Update group completed successfully. Jul 08 02:40:55 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101 1G" returned: 0 in 1.416s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44578b3d-4bd3-4d88-8baa-604df79242fd -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:55 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44578b3d-4bd3-4d88-8baa-604df79242fd -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101 Jul 08 02:40:55 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:56 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-dc927127-c333-44aa-b470-ef39633643d1 tempest-GroupSnapshotsTest-910327665 None] Update group completed successfully. Jul 08 02:40:56 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44578b3d-4bd3-4d88-8baa-604df79242fd -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101" returned: 0 in 1.151s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:56 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 02:40:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:56 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101 Jul 08 02:40:56 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:57 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101" returned: 0 in 1.125s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:57 devstack sudo[93586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.info Jul 08 02:40:57 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:57 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-351cbdfa-a1e6-47f9-85ca-c106fccea487 tempest-GroupSnapshotsTest-910327665 None] Update group completed successfully. Jul 08 02:40:58 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.info" returned: 0 in 1.223s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:58 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 02:40:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:40:58 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.info Jul 08 02:40:58 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:40:59 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] GroupSnapshot 4b01c006-2c34-47c8-8840-3469384a7ab7: creating. Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Group snapshot 4b01c006-2c34-47c8-8840-3469384a7ab7: creating. {{(pid=87238) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Flow 'volume_create_manager' (f7f4c60a-d465-4ca4-8ebf-93d9d7da3910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c20b68d-3691-4cf7-99ca-b349cbf849c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c20b68d-3691-4cf7-99ca-b349cbf849c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1273685462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83022f0-e251-4887-b360-1a00236d9b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8736552a0853435cb998414962fb6865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:00Z,use_quota=True,user_id='369dd135da0d45f9a8f829cfe98d701a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0f35e8-dd6b-4eea-8012-cc2df82a05bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0f35e8-dd6b-4eea-8012-cc2df82a05bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b571e1-b8c5-4a0a-b5b3-4fc6488aea96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b571e1-b8c5-4a0a-b5b3-4fc6488aea96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83022f0-e251-4887-b360-1a00236d9b9d', 'volume_name': 'volume-f83022f0-e251-4887-b360-1a00236d9b9d', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b3c2ae-d1ab-4d5c-bf18-d4975878ebd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b3c2ae-d1ab-4d5c-bf18-d4975878ebd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:40:59 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39670cb3-2e9e-4be6-8657-1b07c94b5354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:40:59 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Volume f83022f0-e251-4887-b360-1a00236d9b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83022f0-e251-4887-b360-1a00236d9b9d', 'volume_size': 1} Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.info" returned: 0 in 1.228s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.613s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.378s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:40:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Creating offline snapshot c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 of volume 7dfcadac-ebaf-4f19-b317-2b0b30288f4c {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:41:00 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db085c3-4ce4-404f-b8d8-5273093a1f59]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:00 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5de24dfd-a800-43d1-a102-ae31742b0aa1 tempest-GroupSnapshotsV319Test-118900537 None] group_snapshot 9670305b-c20a-4c3d-b5cb-12645a9a11a7: created successfully Jul 08 02:41:00 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c Jul 08 02:41:00 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:00 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] group_snapshot 9670305b-c20a-4c3d-b5cb-12645a9a11a7: deleting Jul 08 02:41:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] group_snapshot 9670305b-c20a-4c3d-b5cb-12645a9a11a7: deleting {{(pid=87238) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 02:41:00 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] Acquiring lock "cinder-quobyte-44578b3d-4bd3-4d88-8baa-604df79242fd" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:00 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] Lock "cinder-quobyte-44578b3d-4bd3-4d88-8baa-604df79242fd" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:00 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] Acquiring lock "cinder-quobyte-39210f8c-0c33-405e-ad0c-63edef6fb101" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:00 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] Lock "cinder-quobyte-39210f8c-0c33-405e-ad0c-63edef6fb101" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] Deleting offline snapshot 39210f8c-0c33-405e-ad0c-63edef6fb101 of volume 44578b3d-4bd3-4d88-8baa-604df79242fd {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:41:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] snapshot_file for this snap is: volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:41:00 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ced51c9-aa99-42e8-b506-f5c91b459b22]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:01 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101 Jul 08 02:41:01 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:01 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c" returned: 0 in 1.021s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:01 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 1G Jul 08 02:41:01 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:01 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101" returned: 0 in 0.862s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44578b3d-4bd3-4d88-8baa-604df79242fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:41:01 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[c801c221-5ba5-4c17-a246-3ef55345f76c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:01 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd Jul 08 02:41:01 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:02 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 1G" returned: 0 in 0.957s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:02 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 Jul 08 02:41:02 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:02 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd" returned: 0 in 0.944s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:02 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101 Jul 08 02:41:02 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:02 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40" returned: 0 in 0.848s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:02 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 02:41:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:02 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 Jul 08 02:41:02 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:03 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101" returned: 0 in 0.792s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:03 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40" returned: 0 in 0.689s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:03 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101 Jul 08 02:41:03 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:03 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.info Jul 08 02:41:03 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:04 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd.39210f8c-0c33-405e-ad0c-63edef6fb101" returned: 0 in 0.791s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] Lock "cinder-quobyte-39210f8c-0c33-405e-ad0c-63edef6fb101" released by "_delete_snapshot" :: held 3.501s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] Lock "cinder-quobyte-44578b3d-4bd3-4d88-8baa-604df79242fd" released by "delete_snapshot" :: held 3.532s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:04 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.info" returned: 0 in 0.799s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:04 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 02:41:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:04 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.info Jul 08 02:41:04 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:04 devstack cinder-volume[87238]: WARNING cinder.quota [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1099767148 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1099767148, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:41:04 devstack cinder-volume[87238]: WARNING cinder.quota [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1099767148 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1099767148, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:41:04 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] Created reservations ['f4e01273-2fc0-4305-9d30-f3017e8db543', 'e1cfa546-2d07-4143-af34-c92bccc7d5e8', 'e3cbea21-1c07-4131-adbb-5f13b6fd9d36', '24513384-0160-46c6-8ef2-04a69325acb8'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:04 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-01883763-c77a-4463-b4b8-1b1319e100b3 tempest-GroupSnapshotsV319Test-118900537 None] group_snapshot 9670305b-c20a-4c3d-b5cb-12645a9a11a7: deleted successfully Jul 08 02:41:05 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.info" returned: 0 in 0.680s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.136s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Creating offline snapshot fd1aed48-34eb-4ea2-aa4d-835796e2ae2d of volume cfd00a96-bfa3-490b-b06e-51419502a199 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:41:05 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ac1703-fe91-496a-b9aa-35fbd4fc6931]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:05 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199 Jul 08 02:41:05 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] Acquiring lock "cinder-quobyte-44578b3d-4bd3-4d88-8baa-604df79242fd" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] Lock "cinder-quobyte-44578b3d-4bd3-4d88-8baa-604df79242fd" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:05 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[74058fee-729b-4006-b1af-d8652bae6927]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:05 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd Jul 08 02:41:05 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:05 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199" returned: 0 in 0.857s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:06 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d 1G Jul 08 02:41:06 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:06 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd" returned: 0 in 0.877s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:06 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd Jul 08 02:41:06 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:06 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d 1G" returned: 0 in 0.946s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfd00a96-bfa3-490b-b06e-51419502a199 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:06 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfd00a96-bfa3-490b-b06e-51419502a199 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d Jul 08 02:41:06 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:07 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44578b3d-4bd3-4d88-8baa-604df79242fd" returned: 0 in 0.777s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] Lock "cinder-quobyte-44578b3d-4bd3-4d88-8baa-604df79242fd" released by "delete_volume" :: held 1.734s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:07 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] Created reservations ['7f9da8f9-f906-4ff9-9844-7b2581f8f233'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:07 devstack cinder-volume[87238]: WARNING cinder.quota [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1099767148 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1099767148, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:41:07 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] Created reservations ['04edbbad-4be9-43f9-937c-df2690a86759', '18406424-af26-4674-a2b4-756fb5a4131e', '593d58fc-355f-4c62-98c8-a64a6450b553', '0a052c1e-c632-4608-a25b-08b4c6fd29f5'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:07 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:41:07 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:07 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfd00a96-bfa3-490b-b06e-51419502a199 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d" returned: 0 in 0.852s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:07 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d is being set with open permissions: ugo+rw: NotImplementedError Jul 08 02:41:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:07 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d Jul 08 02:41:07 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:08 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.060s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:08 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:41:08 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0a3e6404-88e2-4151-b07e-95cb1b961e17 tempest-GroupSnapshotsV319Test-118900537 None] Delete group completed successfully. Jul 08 02:41:08 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d" returned: 0 in 1.091s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:09 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.info Jul 08 02:41:09 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:09 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:41:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Flow 'volume_create_manager' (efdb25ce-c1fe-42cf-a6e3-ccc6c6499c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b16195-2297-4a71-99f7-c6c3a5d61de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b16195-2297-4a71-99f7-c6c3a5d61de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1688005286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03de4691-63ca-4bff-97a9-73b5cf4859fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd67751646642518d799868008a35c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:09Z,use_quota=True,user_id='83ffcf853a164e45ba970f434b142c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bc2f64-52e0-4a34-a734-8012c1c205c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bc2f64-52e0-4a34-a734-8012c1c205c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439d7f9e-4477-44e6-b0f1-fe54ca0ece6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439d7f9e-4477-44e6-b0f1-fe54ca0ece6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03de4691-63ca-4bff-97a9-73b5cf4859fc', 'volume_name': 'volume-03de4691-63ca-4bff-97a9-73b5cf4859fc', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb964f44-1384-408f-8a62-7d1b27735b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb964f44-1384-408f-8a62-7d1b27735b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bd0ec3-9257-44c7-89fc-0d0f90130360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:09 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Volume 03de4691-63ca-4bff-97a9-73b5cf4859fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03de4691-63ca-4bff-97a9-73b5cf4859fc', 'volume_size': 1} Jul 08 02:41:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:09 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.info" returned: 0 in 0.740s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:09 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 02:41:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:09 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.info Jul 08 02:41:09 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:10 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.info" returned: 0 in 0.992s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.636s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.810s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1273685462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83022f0-e251-4887-b360-1a00236d9b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8736552a0853435cb998414962fb6865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:00Z,use_quota=True,user_id='369dd135da0d45f9a8f829cfe98d701a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:41:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Creating volume f83022f0-e251-4887-b360-1a00236d9b9d {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:41:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:41:10 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:41:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f83022f0-e251-4887-b360-1a00236d9b9d 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:10 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f83022f0-e251-4887-b360-1a00236d9b9d 1073741824 Jul 08 02:41:10 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:11 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b8e0bb92-f3e0-458f-9554-975575336a54 tempest-GroupSnapshotsTest-910327665 None] group_snapshot 4b01c006-2c34-47c8-8840-3469384a7ab7: created successfully Jul 08 02:41:11 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] group_snapshot 4b01c006-2c34-47c8-8840-3469384a7ab7: deleting Jul 08 02:41:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] group_snapshot 4b01c006-2c34-47c8-8840-3469384a7ab7: deleting {{(pid=87238) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 02:41:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "cinder-quobyte-7dfcadac-ebaf-4f19-b317-2b0b30288f4c" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-7dfcadac-ebaf-4f19-b317-2b0b30288f4c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "cinder-quobyte-c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Deleting offline snapshot c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 of volume 7dfcadac-ebaf-4f19-b317-2b0b30288f4c {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:41:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] snapshot_file for this snap is: volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:41:11 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[629b713c-6ac4-4630-8fb3-40105cacdeaa]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:11 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 Jul 08 02:41:11 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:12 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f83022f0-e251-4887-b360-1a00236d9b9d 1073741824" returned: 0 in 1.786s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f83022f0-e251-4887-b360-1a00236d9b9d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:12 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f83022f0-e251-4887-b360-1a00236d9b9d Jul 08 02:41:12 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:13 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40" returned: 0 in 1.290s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[633e8635-6d0a-4e82-bae5-a02a8d4afd9b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:13 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c Jul 08 02:41:13 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:13 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f83022f0-e251-4887-b360-1a00236d9b9d" returned: 0 in 0.819s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] <== create_volume: return (2703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.708s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.247s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1688005286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03de4691-63ca-4bff-97a9-73b5cf4859fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd67751646642518d799868008a35c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:09Z,use_quota=True,user_id='83ffcf853a164e45ba970f434b142c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Creating volume 03de4691-63ca-4bff-97a9-73b5cf4859fc {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:41:13 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03de4691-63ca-4bff-97a9-73b5cf4859fc 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39670cb3-2e9e-4be6-8657-1b07c94b5354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83022f0-e251-4887-b360-1a00236d9b9d', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12824a57-1bd6-4dde-ad50-5e31bb14f4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:13 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03de4691-63ca-4bff-97a9-73b5cf4859fc 1073741824 Jul 08 02:41:13 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:13 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Volume volume-f83022f0-e251-4887-b360-1a00236d9b9d (f83022f0-e251-4887-b360-1a00236d9b9d): created successfully Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12824a57-1bd6-4dde-ad50-5e31bb14f4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Flow 'volume_create_manager' (f7f4c60a-d465-4ca4-8ebf-93d9d7da3910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:13 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2774f121-173e-417f-acd3-1b616c80b533 tempest-VolumesTransfersV355Test-1960078563 None] Created volume successfully. Jul 08 02:41:14 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c" returned: 0 in 1.769s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:14 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 Jul 08 02:41:14 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:15 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03de4691-63ca-4bff-97a9-73b5cf4859fc 1073741824" returned: 0 in 1.586s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03de4691-63ca-4bff-97a9-73b5cf4859fc {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:15 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03de4691-63ca-4bff-97a9-73b5cf4859fc Jul 08 02:41:15 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:15 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c1462bd2-a6a8-4bb1-a520-c27f49b3eb8a tempest-VolumesTransfersV355Test-995303422 None] Transfer volume completed successfully. Jul 08 02:41:16 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40" returned: 0 in 1.139s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:16 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40 Jul 08 02:41:16 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:16 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03de4691-63ca-4bff-97a9-73b5cf4859fc" returned: 0 in 1.137s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] <== create_volume: return (2790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:41:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.793s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bd0ec3-9257-44c7-89fc-0d0f90130360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03de4691-63ca-4bff-97a9-73b5cf4859fc', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2c6d70-b3d9-4593-9ad0-9329a6c59261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:16 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Volume volume-03de4691-63ca-4bff-97a9-73b5cf4859fc (03de4691-63ca-4bff-97a9-73b5cf4859fc): created successfully Jul 08 02:41:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2c6d70-b3d9-4593-9ad0-9329a6c59261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Flow 'volume_create_manager' (efdb25ce-c1fe-42cf-a6e3-ccc6c6499c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:16 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-866c1725-5a32-4697-84a6-ebe8d46de9ef tempest-ServerRescueNegativeTestJSON-558792468 None] Created volume successfully. Jul 08 02:41:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Acquiring lock "cinder-f83022f0-e251-4887-b360-1a00236d9b9d-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Lock "cinder-f83022f0-e251-4887-b360-1a00236d9b9d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Acquiring lock "cinder-quobyte-f83022f0-e251-4887-b360-1a00236d9b9d" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Lock "cinder-quobyte-f83022f0-e251-4887-b360-1a00236d9b9d" acquired by "delete_volume" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:16 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eba5c69-e15f-4218-a7ca-de9dda0a8c4f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f83022f0-e251-4887-b360-1a00236d9b9d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:16 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c.c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40" returned: 0 in 0.990s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-c9bf2c03-10f4-4b5a-bda8-1e377f9b6c40" released by "_delete_snapshot" :: held 5.392s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:17 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-786ca0cc-4477-4cb3-828e-9b7161d9a66c tempest-GroupsTest-2036430055 None] Group tempest-Group1-1984246694: creating Jul 08 02:41:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-7dfcadac-ebaf-4f19-b317-2b0b30288f4c" released by "delete_snapshot" :: held 5.429s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:17 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f83022f0-e251-4887-b360-1a00236d9b9d Jul 08 02:41:17 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "cinder-quobyte-cfd00a96-bfa3-490b-b06e-51419502a199" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-cfd00a96-bfa3-490b-b06e-51419502a199" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "cinder-quobyte-fd1aed48-34eb-4ea2-aa4d-835796e2ae2d" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:17 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-786ca0cc-4477-4cb3-828e-9b7161d9a66c tempest-GroupsTest-2036430055 None] Group tempest-Group1-1984246694: created successfully Jul 08 02:41:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-fd1aed48-34eb-4ea2-aa4d-835796e2ae2d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Deleting offline snapshot fd1aed48-34eb-4ea2-aa4d-835796e2ae2d of volume cfd00a96-bfa3-490b-b06e-51419502a199 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:41:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] snapshot_file for this snap is: volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:41:17 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-786ca0cc-4477-4cb3-828e-9b7161d9a66c tempest-GroupsTest-2036430055 None] Create group completed successfully. Jul 08 02:41:17 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5307f7-9c05-44ad-b54b-97e8ceb4c00c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:17 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d Jul 08 02:41:17 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:17 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f83022f0-e251-4887-b360-1a00236d9b9d" returned: 0 in 0.960s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f83022f0-e251-4887-b360-1a00236d9b9d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:17 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f83022f0-e251-4887-b360-1a00236d9b9d Jul 08 02:41:17 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:18 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d" returned: 0 in 0.969s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfd00a96-bfa3-490b-b06e-51419502a199(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:41:18 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[4652ac3f-bad1-4c07-a58a-1004cb9cafbd]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:18 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3a885ea5-28b4-482b-94a8-289c07682c6a tempest-GroupsTest-2036430055 None] Group tempest-Group2-1016984903: creating Jul 08 02:41:18 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3a885ea5-28b4-482b-94a8-289c07682c6a tempest-GroupsTest-2036430055 None] Group tempest-Group2-1016984903: created successfully Jul 08 02:41:18 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3a885ea5-28b4-482b-94a8-289c07682c6a tempest-GroupsTest-2036430055 None] Create group completed successfully. Jul 08 02:41:18 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199 Jul 08 02:41:18 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:18 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f83022f0-e251-4887-b360-1a00236d9b9d" returned: 0 in 1.040s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Lock "cinder-quobyte-f83022f0-e251-4887-b360-1a00236d9b9d" released by "delete_volume" :: held 2.087s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:19 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Created reservations ['e94889c9-983c-494d-bd81-d8a5fae777f3', '27d99e7a-fa38-4d0b-b75e-56a19c830629', 'dd93a7d7-fcb6-43a6-a121-7aebbcff009b', '52037433-9027-4a62-9024-ceff95fc4240'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:19 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:41:19 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:19 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199" returned: 0 in 1.262s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:19 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d Jul 08 02:41:19 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:20 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.863s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:41:20 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Deleted volume successfully. Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f82b5a6e-6387-45ee-bc13-a734b169b7c1 tempest-VolumesTransfersV355Test-1272745895 None] Lock "cinder-f83022f0-e251-4887-b360-1a00236d9b9d-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Flow 'volume_create_manager' (55cc0816-4c37-4929-a067-3a1292f39a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e92c06-1f19-4aec-b98c-349c1da036c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e92c06-1f19-4aec-b98c-349c1da036c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1866757148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3738c895-83b5-421a-b227-b221a108fb7b,host='devstack@QuobyteHD#QuobyteHD',id=5a2b2886-9a3b-4913-81f9-174380ba1268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68711200437483197604a1a9760b880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:20Z,use_quota=True,user_id='67b9876697d94b358907d4e97e92a8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(995bf495-0be5-4aac-b9cf-ea71d05d5e87),volume_type_id=995bf495-0be5-4aac-b9cf-ea71d05d5e87)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95cd9217-c52c-4c11-8412-481c607faf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95cd9217-c52c-4c11-8412-481c607faf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8e1c21-9caf-4deb-a43c-b622d9468584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8e1c21-9caf-4deb-a43c-b622d9468584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2b2886-9a3b-4913-81f9-174380ba1268', 'volume_name': 'volume-5a2b2886-9a3b-4913-81f9-174380ba1268', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (443b6950-d539-4936-87e2-88fba7aa1432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (443b6950-d539-4936-87e2-88fba7aa1432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141ed667-2aef-4d3d-9a58-8bbedc1a5181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:20 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Volume 5a2b2886-9a3b-4913-81f9-174380ba1268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2b2886-9a3b-4913-81f9-174380ba1268', 'volume_size': 1} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3738c895-83b5-421a-b227-b221a108fb7b,created_at=2026-07-08T00:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1866757148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3738c895-83b5-421a-b227-b221a108fb7b,host='devstack@QuobyteHD#QuobyteHD',id=5a2b2886-9a3b-4913-81f9-174380ba1268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68711200437483197604a1a9760b880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:20Z,use_quota=True,user_id='67b9876697d94b358907d4e97e92a8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(995bf495-0be5-4aac-b9cf-ea71d05d5e87),volume_type_id=995bf495-0be5-4aac-b9cf-ea71d05d5e87)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Creating volume 5a2b2886-9a3b-4913-81f9-174380ba1268 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:41:20 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5a2b2886-9a3b-4913-81f9-174380ba1268 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:20 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5a2b2886-9a3b-4913-81f9-174380ba1268 1073741824 Jul 08 02:41:20 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:20 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d" returned: 0 in 1.327s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:20 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d Jul 08 02:41:20 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Flow 'volume_create_manager' (dbb77150-9bd4-43c1-9837-2c7b02473f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ff1c56-f7d0-417a-b98f-4065fd8b09ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ff1c56-f7d0-417a-b98f-4065fd8b09ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1024838161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db947273-eef9-4c65-aed6-50e95ab6097c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8736552a0853435cb998414962fb6865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:21Z,use_quota=True,user_id='369dd135da0d45f9a8f829cfe98d701a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e7cb98-e485-4532-972b-fea54c877013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e7cb98-e485-4532-972b-fea54c877013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d136ac3-1b25-474b-b1f1-fdcfb1f31ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d136ac3-1b25-474b-b1f1-fdcfb1f31ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db947273-eef9-4c65-aed6-50e95ab6097c', 'volume_name': 'volume-db947273-eef9-4c65-aed6-50e95ab6097c', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f50bca-b2d9-4e23-9ae3-20df68a6e814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f50bca-b2d9-4e23-9ae3-20df68a6e814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c981eef4-03ed-4257-8513-7bfe2bd68706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:21 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Volume db947273-eef9-4c65-aed6-50e95ab6097c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db947273-eef9-4c65-aed6-50e95ab6097c', 'volume_size': 1} Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:21 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5a2b2886-9a3b-4913-81f9-174380ba1268 1073741824" returned: 0 in 0.920s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:21 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199.fd1aed48-34eb-4ea2-aa4d-835796e2ae2d" returned: 0 in 0.766s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5a2b2886-9a3b-4913-81f9-174380ba1268 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-fd1aed48-34eb-4ea2-aa4d-835796e2ae2d" released by "_delete_snapshot" :: held 4.465s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-cfd00a96-bfa3-490b-b06e-51419502a199" released by "delete_snapshot" :: held 4.505s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:21 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5a2b2886-9a3b-4913-81f9-174380ba1268 Jul 08 02:41:21 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:21 devstack cinder-volume[87238]: WARNING cinder.quota [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-301880012 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-301880012, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:41:21 devstack cinder-volume[87238]: WARNING cinder.quota [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-301880012 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-301880012, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Created reservations ['ade4a7d2-2dd9-42b2-b4a8-42bba8e11fd6', '773b4ed3-175e-48a6-874f-ecec0f4cc932', '3148ed8e-f311-4abc-9432-abf9d62bcad3', '64df242b-904b-4460-bf14-853826d7b71b'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:21 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] Created reservations ['7a5c867e-44d0-49f9-acdf-220eb9f13138', '23278574-eeb6-4cc8-867e-e8e41c61e835', '24b83279-8090-46e8-af88-3c47dbd21f44', '3ea780f9-cfd0-48bf-bac5-2728856e348f'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:21 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-22126793-daa5-4c6f-848a-90fa4eb7f12e tempest-GroupSnapshotsTest-910327665 None] group_snapshot 4b01c006-2c34-47c8-8840-3469384a7ab7: deleted successfully Jul 08 02:41:22 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5a2b2886-9a3b-4913-81f9-174380ba1268" returned: 0 in 0.687s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.200s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1024838161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db947273-eef9-4c65-aed6-50e95ab6097c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8736552a0853435cb998414962fb6865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:21Z,use_quota=True,user_id='369dd135da0d45f9a8f829cfe98d701a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Creating volume db947273-eef9-4c65-aed6-50e95ab6097c {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:41:22 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db947273-eef9-4c65-aed6-50e95ab6097c 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141ed667-2aef-4d3d-9a58-8bbedc1a5181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2b2886-9a3b-4913-81f9-174380ba1268', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:22 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db947273-eef9-4c65-aed6-50e95ab6097c 1073741824 Jul 08 02:41:22 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98bd00ff-ff92-494a-83a5-7fb663b87026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:22 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Volume volume-5a2b2886-9a3b-4913-81f9-174380ba1268 (5a2b2886-9a3b-4913-81f9-174380ba1268): created successfully Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98bd00ff-ff92-494a-83a5-7fb663b87026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Flow 'volume_create_manager' (55cc0816-4c37-4929-a067-3a1292f39a8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:22 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3b22b822-88ea-46e0-b8db-387f8056f69c tempest-GroupsTest-2036430055 None] Created volume successfully. Jul 08 02:41:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "cinder-quobyte-7dfcadac-ebaf-4f19-b317-2b0b30288f4c" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:23 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db947273-eef9-4c65-aed6-50e95ab6097c 1073741824" returned: 0 in 0.996s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-7dfcadac-ebaf-4f19-b317-2b0b30288f4c" acquired by "delete_volume" :: waited 0.035s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:23 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5de81d-1295-4e37-ab60-c3b5e5d98ced]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db947273-eef9-4c65-aed6-50e95ab6097c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:23 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db947273-eef9-4c65-aed6-50e95ab6097c Jul 08 02:41:23 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Acquiring lock "cinder-quobyte-5a2b2886-9a3b-4913-81f9-174380ba1268" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Lock "cinder-quobyte-5a2b2886-9a3b-4913-81f9-174380ba1268" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:23 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c Jul 08 02:41:23 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:23 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7da2765-51d0-4e07-8771-9717a3063fc0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5a2b2886-9a3b-4913-81f9-174380ba1268 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:23 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5a2b2886-9a3b-4913-81f9-174380ba1268 Jul 08 02:41:23 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:24 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db947273-eef9-4c65-aed6-50e95ab6097c" returned: 0 in 0.731s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c981eef4-03ed-4257-8513-7bfe2bd68706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db947273-eef9-4c65-aed6-50e95ab6097c', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b86cfd-cbc0-42f0-bb1e-51bc3543f394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:24 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Volume volume-db947273-eef9-4c65-aed6-50e95ab6097c (db947273-eef9-4c65-aed6-50e95ab6097c): created successfully Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b86cfd-cbc0-42f0-bb1e-51bc3543f394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Flow 'volume_create_manager' (dbb77150-9bd4-43c1-9837-2c7b02473f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:24 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c" returned: 0 in 0.837s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:24 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3b10f006-1e5c-466e-86dd-cbb10dc63c02 tempest-VolumesTransfersV355Test-1960078563 None] Created volume successfully. Jul 08 02:41:24 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c Jul 08 02:41:24 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:24 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5a2b2886-9a3b-4913-81f9-174380ba1268" returned: 0 in 0.874s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5a2b2886-9a3b-4913-81f9-174380ba1268 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:24 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5a2b2886-9a3b-4913-81f9-174380ba1268 Jul 08 02:41:24 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Acquiring lock "cinder-db947273-eef9-4c65-aed6-50e95ab6097c-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Lock "cinder-db947273-eef9-4c65-aed6-50e95ab6097c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Acquiring lock "cinder-quobyte-db947273-eef9-4c65-aed6-50e95ab6097c" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Lock "cinder-quobyte-db947273-eef9-4c65-aed6-50e95ab6097c" acquired by "delete_volume" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaa9236-510f-4135-adef-4e12c13f704c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db947273-eef9-4c65-aed6-50e95ab6097c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:25 devstack sudo[93923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db947273-eef9-4c65-aed6-50e95ab6097c Jul 08 02:41:25 devstack sudo[93923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:25 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7dfcadac-ebaf-4f19-b317-2b0b30288f4c" returned: 0 in 0.821s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-7dfcadac-ebaf-4f19-b317-2b0b30288f4c" released by "delete_volume" :: held 1.742s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "cinder-quobyte-cfd00a96-bfa3-490b-b06e-51419502a199" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-cfd00a96-bfa3-490b-b06e-51419502a199" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a994578-d03c-44ae-b951-b732a3302869]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:25 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5a2b2886-9a3b-4913-81f9-174380ba1268" returned: 0 in 0.770s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Lock "cinder-quobyte-5a2b2886-9a3b-4913-81f9-174380ba1268" released by "delete_volume" :: held 1.694s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:25 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199 Jul 08 02:41:25 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Created reservations ['de7a6235-2ce8-4538-a5f7-ae6478a6caeb'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:25 devstack cinder-volume[87238]: WARNING cinder.quota [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-591678834 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-591678834, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:41:25 devstack cinder-volume[87238]: WARNING cinder.quota [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-591678834 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-591678834, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Created reservations ['15612dac-3439-40d1-8e19-1f9846a9b3e5', '388c9234-fe73-43f7-9e91-dbd70c7bae75', '8cd9c562-a62e-42aa-88d7-accd97fccaeb', '53befbd3-e032-430c-b75f-f0810c794978'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:25 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:41:25 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:25 devstack sudo[93923]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db947273-eef9-4c65-aed6-50e95ab6097c" returned: 0 in 0.895s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db947273-eef9-4c65-aed6-50e95ab6097c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:25 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db947273-eef9-4c65-aed6-50e95ab6097c Jul 08 02:41:25 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-b5f18618-6d55-41a5-90ea-e1767844c2c5 tempest-GroupsTest-2036430055 None] Created reservations ['d645218a-7d81-4670-a9c7-aaad369b7088'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b5f18618-6d55-41a5-90ea-e1767844c2c5 tempest-GroupsTest-2036430055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b5f18618-6d55-41a5-90ea-e1767844c2c5 tempest-GroupsTest-2036430055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b5f18618-6d55-41a5-90ea-e1767844c2c5 tempest-GroupsTest-2036430055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b5f18618-6d55-41a5-90ea-e1767844c2c5 tempest-GroupsTest-2036430055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b5f18618-6d55-41a5-90ea-e1767844c2c5 tempest-GroupsTest-2036430055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5f18618-6d55-41a5-90ea-e1767844c2c5 tempest-GroupsTest-2036430055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:26 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.739s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:41:26 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-712d4afd-fbce-4d46-95b0-8e75e53959bf tempest-GroupsTest-2036430055 None] Delete group completed successfully. Jul 08 02:41:26 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:41:26 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:26 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199" returned: 0 in 1.065s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:26 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199 Jul 08 02:41:26 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:26 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db947273-eef9-4c65-aed6-50e95ab6097c" returned: 0 in 0.853s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Lock "cinder-quobyte-db947273-eef9-4c65-aed6-50e95ab6097c" released by "delete_volume" :: held 1.793s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Created reservations ['98c50c90-d50c-4c6a-8fa9-9c5a8ac77d80', 'c624e062-5d69-4dd4-9af6-c4084a3c1a24', '3f7de609-b541-413f-a5cc-2fab589221b8', '4993ea35-8302-4604-a0e1-a6b74bb2df91'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:26 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5f18618-6d55-41a5-90ea-e1767844c2c5 tempest-GroupsTest-2036430055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.692s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-b5f18618-6d55-41a5-90ea-e1767844c2c5 tempest-GroupsTest-2036430055 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:41:26 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b5f18618-6d55-41a5-90ea-e1767844c2c5 tempest-GroupsTest-2036430055 None] Delete group completed successfully. Jul 08 02:41:26 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:41:26 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:26 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cfd00a96-bfa3-490b-b06e-51419502a199" returned: 0 in 0.751s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-cfd00a96-bfa3-490b-b06e-51419502a199" released by "delete_volume" :: held 1.896s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:27 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Created reservations ['94a31941-41fd-4ad8-9779-cecff4da5daf'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:27 devstack cinder-volume[87238]: WARNING cinder.quota [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-301880012 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-301880012, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:41:27 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Created reservations ['4771e7f7-54b0-4e3c-af1b-7388217a9086', 'be513356-954e-43fb-9a9d-7a0693b19e47', '3addae86-b2b3-4872-af3b-4c7786a1029e', '02dd8c74-4494-4f38-a64f-e7641282ac3f'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:27 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Created reservations ['5005d87e-ee8d-4147-99a9-592db908bab7', '6c526d0a-860c-44df-ab40-e6eb8436e0c0', '88e2a762-8bea-43ad-acb5-f75d4b7d5031', '77aa1fb1-f7ed-4ffc-a973-2138f8037ec1'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:27 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.865s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:27 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:41:27 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Deleted volume successfully. Jul 08 02:41:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-947b4213-6dd1-48ea-b5a2-7f15713f28bc tempest-VolumesTransfersV355Test-1272745895 None] Lock "cinder-db947273-eef9-4c65-aed6-50e95ab6097c-delete_volume" released by "delete_volume" :: held 3.051s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:27 devstack sudo[93974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:41:27 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:28 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-6dfdbe8e-8b67-45bb-ad31-bc8538558fd9 tempest-GroupsTest-2036430055 None] Group tempest-GroupsTest-Group-1677795773: creating Jul 08 02:41:28 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-6dfdbe8e-8b67-45bb-ad31-bc8538558fd9 tempest-GroupsTest-2036430055 None] Group tempest-GroupsTest-Group-1677795773: created successfully Jul 08 02:41:28 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-6dfdbe8e-8b67-45bb-ad31-bc8538558fd9 tempest-GroupsTest-2036430055 None] Create group completed successfully. Jul 08 02:41:28 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.171s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:28 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:41:28 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-d98ea3dc-f5c5-4c56-a472-5b5d04e8671e tempest-GroupSnapshotsTest-910327665 None] Delete group completed successfully. Jul 08 02:41:29 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-70741b98-6c57-475f-8d77-94de22306d51 tempest-GroupSnapshotsTest-910327665 None] Group tempest-GroupSnapshotsTest-Group-674750899: creating Jul 08 02:41:29 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-70741b98-6c57-475f-8d77-94de22306d51 tempest-GroupSnapshotsTest-910327665 None] Group tempest-GroupSnapshotsTest-Group-674750899: created successfully Jul 08 02:41:29 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-70741b98-6c57-475f-8d77-94de22306d51 tempest-GroupSnapshotsTest-910327665 None] Create group completed successfully. Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Flow 'volume_create_manager' (b8b9c167-5c31-4126-b179-c7985f2b1176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00710161-5b70-4cd4-87e3-c1e4a1f7504c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00710161-5b70-4cd4-87e3-c1e4a1f7504c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1708034017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c03c1a90-e764-49db-aafc-f1292d286d9f,host='devstack@QuobyteHD#QuobyteHD',id=10de495c-1dab-43cc-8edf-87a6d5d2684e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68711200437483197604a1a9760b880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:30Z,use_quota=True,user_id='67b9876697d94b358907d4e97e92a8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1357383-3c60-462d-aa6b-5c5ad0302885),volume_type_id=d1357383-3c60-462d-aa6b-5c5ad0302885)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36254a7d-21fd-41ef-9502-20e71d84359f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36254a7d-21fd-41ef-9502-20e71d84359f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcca713e-cc31-4f48-aeb1-78f913f91fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcca713e-cc31-4f48-aeb1-78f913f91fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10de495c-1dab-43cc-8edf-87a6d5d2684e', 'volume_name': 'volume-10de495c-1dab-43cc-8edf-87a6d5d2684e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66eb9ebd-dddb-4099-8c0c-ce97218cafc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66eb9ebd-dddb-4099-8c0c-ce97218cafc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64869ef8-1c32-4d62-8dd8-aa2c93a58056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:30 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Volume 10de495c-1dab-43cc-8edf-87a6d5d2684e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10de495c-1dab-43cc-8edf-87a6d5d2684e', 'volume_size': 1} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c03c1a90-e764-49db-aafc-f1292d286d9f,created_at=2026-07-08T00:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1708034017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c03c1a90-e764-49db-aafc-f1292d286d9f,host='devstack@QuobyteHD#QuobyteHD',id=10de495c-1dab-43cc-8edf-87a6d5d2684e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68711200437483197604a1a9760b880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:30Z,use_quota=True,user_id='67b9876697d94b358907d4e97e92a8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1357383-3c60-462d-aa6b-5c5ad0302885),volume_type_id=d1357383-3c60-462d-aa6b-5c5ad0302885)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Creating volume 10de495c-1dab-43cc-8edf-87a6d5d2684e {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:41:30 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:41:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-10de495c-1dab-43cc-8edf-87a6d5d2684e 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:30 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-10de495c-1dab-43cc-8edf-87a6d5d2684e 1073741824 Jul 08 02:41:30 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:31 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:41:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Flow 'volume_create_manager' (db514920-4d45-49ee-8858-0a23f2b549b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9dd2d4f-7488-4d26-8cfc-114db47e6a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9dd2d4f-7488-4d26-8cfc-114db47e6a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-142150019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=edf06e43-58d9-4360-8cc8-663dcf41ef2a,host='devstack@QuobyteHD#QuobyteHD',id=f9d0fb5d-f5fe-49ab-a301-92d7db803257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323f0bb16974456ca1b52bf702ba40a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:32Z,use_quota=True,user_id='fba714f94dcb4e55ab174ee5da641c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44947927-3265-4995-9b73-24dd9c80fe42),volume_type_id=44947927-3265-4995-9b73-24dd9c80fe42)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e668ed1d-4525-46d7-ab13-1b658bcd922a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e668ed1d-4525-46d7-ab13-1b658bcd922a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21cd25a-503b-4c94-a06a-73bddd5ef824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21cd25a-503b-4c94-a06a-73bddd5ef824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d0fb5d-f5fe-49ab-a301-92d7db803257', 'volume_name': 'volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071f2059-5d42-45ae-8213-58fd16b328c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071f2059-5d42-45ae-8213-58fd16b328c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a866ec31-facc-4706-983e-03227ab54fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:31 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Volume f9d0fb5d-f5fe-49ab-a301-92d7db803257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257', 'volume_size': 1} Jul 08 02:41:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:32 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-10de495c-1dab-43cc-8edf-87a6d5d2684e 1073741824" returned: 0 in 1.736s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-10de495c-1dab-43cc-8edf-87a6d5d2684e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:32 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-10de495c-1dab-43cc-8edf-87a6d5d2684e Jul 08 02:41:32 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:33 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-10de495c-1dab-43cc-8edf-87a6d5d2684e" returned: 0 in 0.763s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] <== create_volume: return (2555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.561s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.276s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=edf06e43-58d9-4360-8cc8-663dcf41ef2a,created_at=2026-07-08T00:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-142150019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=edf06e43-58d9-4360-8cc8-663dcf41ef2a,host='devstack@QuobyteHD#QuobyteHD',id=f9d0fb5d-f5fe-49ab-a301-92d7db803257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323f0bb16974456ca1b52bf702ba40a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:32Z,use_quota=True,user_id='fba714f94dcb4e55ab174ee5da641c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44947927-3265-4995-9b73-24dd9c80fe42),volume_type_id=44947927-3265-4995-9b73-24dd9c80fe42)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Creating volume f9d0fb5d-f5fe-49ab-a301-92d7db803257 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:41:33 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64869ef8-1c32-4d62-8dd8-aa2c93a58056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10de495c-1dab-43cc-8edf-87a6d5d2684e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:33 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 1073741824 Jul 08 02:41:33 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c59240d-7069-4093-b3af-a7314f1627af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:33 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Volume volume-10de495c-1dab-43cc-8edf-87a6d5d2684e (10de495c-1dab-43cc-8edf-87a6d5d2684e): created successfully Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c59240d-7069-4093-b3af-a7314f1627af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Flow 'volume_create_manager' (b8b9c167-5c31-4126-b179-c7985f2b1176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:33 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-7baad3e9-c4c7-4b8e-a6e0-03f8cb387ddc tempest-GroupsTest-2036430055 None] Created volume successfully. Jul 08 02:41:34 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 1073741824" returned: 0 in 1.191s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:34 devstack sudo[94029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 Jul 08 02:41:34 devstack sudo[94029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Flow 'volume_create_manager' (8f7cae5d-9251-41e9-97d2-0fa74bc2c867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972a588a-d6ad-4601-a704-ca0ecfbf8c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972a588a-d6ad-4601-a704-ca0ecfbf8c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1957341983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c03c1a90-e764-49db-aafc-f1292d286d9f,host='devstack@QuobyteHD#QuobyteHD',id=53b077f5-71ae-434c-8ca5-b709fad1df40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68711200437483197604a1a9760b880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:35Z,use_quota=True,user_id='67b9876697d94b358907d4e97e92a8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1357383-3c60-462d-aa6b-5c5ad0302885),volume_type_id=d1357383-3c60-462d-aa6b-5c5ad0302885)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb2ab5d-74bd-4a12-a398-9be7b91c4d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb2ab5d-74bd-4a12-a398-9be7b91c4d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c225f4-ca32-4db8-b2b3-ddc676814cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c225f4-ca32-4db8-b2b3-ddc676814cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53b077f5-71ae-434c-8ca5-b709fad1df40', 'volume_name': 'volume-53b077f5-71ae-434c-8ca5-b709fad1df40', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131bee3b-7860-493f-bed9-3cff8c9d5bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131bee3b-7860-493f-bed9-3cff8c9d5bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b54ff20-58a5-4c65-a8c4-052e1e516580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:35 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Volume 53b077f5-71ae-434c-8ca5-b709fad1df40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53b077f5-71ae-434c-8ca5-b709fad1df40', 'volume_size': 1} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:35 devstack sudo[94029]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257" returned: 0 in 1.041s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] <== create_volume: return (2334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.276s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c03c1a90-e764-49db-aafc-f1292d286d9f,created_at=2026-07-08T00:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1957341983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c03c1a90-e764-49db-aafc-f1292d286d9f,host='devstack@QuobyteHD#QuobyteHD',id=53b077f5-71ae-434c-8ca5-b709fad1df40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68711200437483197604a1a9760b880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:35Z,use_quota=True,user_id='67b9876697d94b358907d4e97e92a8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1357383-3c60-462d-aa6b-5c5ad0302885),volume_type_id=d1357383-3c60-462d-aa6b-5c5ad0302885)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Creating volume 53b077f5-71ae-434c-8ca5-b709fad1df40 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:41:35 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-53b077f5-71ae-434c-8ca5-b709fad1df40 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a866ec31-facc-4706-983e-03227ab54fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:35 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-53b077f5-71ae-434c-8ca5-b709fad1df40 1073741824 Jul 08 02:41:35 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4350fc6-0bf7-486c-8d4f-60c2ba4ff9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:35 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Volume volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 (f9d0fb5d-f5fe-49ab-a301-92d7db803257): created successfully Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4350fc6-0bf7-486c-8d4f-60c2ba4ff9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Flow 'volume_create_manager' (db514920-4d45-49ee-8858-0a23f2b549b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:35 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-25cd92a7-6ffa-4cd0-a471-52b3168fbe8a tempest-GroupSnapshotsTest-910327665 None] Created volume successfully. Jul 08 02:41:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Acquiring lock "cinder-03de4691-63ca-4bff-97a9-73b5cf4859fc-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Lock "cinder-03de4691-63ca-4bff-97a9-73b5cf4859fc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Acquiring lock "cinder-quobyte-03de4691-63ca-4bff-97a9-73b5cf4859fc" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Lock "cinder-quobyte-03de4691-63ca-4bff-97a9-73b5cf4859fc" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:36 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7730d3e-98de-4a1e-8fd0-bc146865d6f5]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03de4691-63ca-4bff-97a9-73b5cf4859fc {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:36 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03de4691-63ca-4bff-97a9-73b5cf4859fc Jul 08 02:41:36 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:36 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-53b077f5-71ae-434c-8ca5-b709fad1df40 1073741824" returned: 0 in 1.372s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-53b077f5-71ae-434c-8ca5-b709fad1df40 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:37 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-53b077f5-71ae-434c-8ca5-b709fad1df40 Jul 08 02:41:37 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:37 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] GroupSnapshot 418a46be-9879-41d8-849f-d269758d192d: creating. Jul 08 02:41:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] Group snapshot 418a46be-9879-41d8-849f-d269758d192d: creating. {{(pid=87238) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 02:41:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:37 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03de4691-63ca-4bff-97a9-73b5cf4859fc" returned: 0 in 1.352s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03de4691-63ca-4bff-97a9-73b5cf4859fc {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:37 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03de4691-63ca-4bff-97a9-73b5cf4859fc Jul 08 02:41:37 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:38 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-53b077f5-71ae-434c-8ca5-b709fad1df40" returned: 0 in 1.161s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] <== create_volume: return (2613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.619s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.609s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] Creating offline snapshot 19e41632-17e2-4795-bb14-657d458a5bff of volume f9d0fb5d-f5fe-49ab-a301-92d7db803257 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b54ff20-58a5-4c65-a8c4-052e1e516580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53b077f5-71ae-434c-8ca5-b709fad1df40', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d71490a-bd11-4e38-b06e-e5123e96a334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[300634bc-523b-4439-8ad6-15cef9fe5501]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:38 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Volume volume-53b077f5-71ae-434c-8ca5-b709fad1df40 (53b077f5-71ae-434c-8ca5-b709fad1df40): created successfully Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d71490a-bd11-4e38-b06e-e5123e96a334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Flow 'volume_create_manager' (8f7cae5d-9251-41e9-97d2-0fa74bc2c867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:38 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-8d8388ce-f2aa-4fef-9575-c305bd8dde7a tempest-GroupsTest-2036430055 None] Created volume successfully. Jul 08 02:41:38 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03de4691-63ca-4bff-97a9-73b5cf4859fc" returned: 0 in 0.749s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Lock "cinder-quobyte-03de4691-63ca-4bff-97a9-73b5cf4859fc" released by "delete_volume" :: held 2.177s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Created reservations ['74669594-8a76-48e5-a209-5bb55af5ac24', 'c559f1d7-12ae-4c55-bca3-b3a48d3ff9ec', 'e3404022-320b-4634-8c02-c1a39c212e00', '9c4efc1d-026c-41db-8904-8bf9988d97c6'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:38 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 Jul 08 02:41:38 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:38 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:41:38 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Flow 'volume_create_manager' (da2b303f-393f-41d4-b097-cd09232f127a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0c171e-a37f-4d7e-a48c-40c978bf0729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0c171e-a37f-4d7e-a48c-40c978bf0729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1541937069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a69901-cd53-4ec2-8ebd-716e7e27dd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93af6c40e5b48e9afc6f0e55c2fe362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:39Z,use_quota=True,user_id='8d7d5160e20a4bb89a8f78e82766a9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e02491-4a53-400d-bd1a-b0dce05e524e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e02491-4a53-400d-bd1a-b0dce05e524e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e8c4fe4-93c7-4a04-8c6c-0d02679ae38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e8c4fe4-93c7-4a04-8c6c-0d02679ae38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8a69901-cd53-4ec2-8ebd-716e7e27dd7e', 'volume_name': 'volume-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd549fd-d1cd-45ce-90ae-4b94d46df13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd549fd-d1cd-45ce-90ae-4b94d46df13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938591c1-d9bb-47de-9170-4a139fc7129d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:38 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Volume b8a69901-cd53-4ec2-8ebd-716e7e27dd7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e', 'volume_size': 1} Jul 08 02:41:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:38 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ef5ccceb-6bf1-4799-a9f2-e668a76da1f9 tempest-GroupsTest-2036430055 None] Update group completed successfully. Jul 08 02:41:39 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257" returned: 0 in 1.036s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:39 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff 1G Jul 08 02:41:39 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:39 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.858s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:39 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:41:39 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Deleted volume successfully. Jul 08 02:41:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-67f77714-bffd-4a04-9068-b7de9df7724b tempest-ServerRescueNegativeTestJSON-558792468 None] Lock "cinder-03de4691-63ca-4bff-97a9-73b5cf4859fc-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:40 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff 1G" returned: 0 in 0.856s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:40 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff Jul 08 02:41:40 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:40 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b0820b65-a33c-41d9-9e5b-96ae3784fa7d tempest-GroupsTest-2036430055 None] Update group completed successfully. Jul 08 02:41:40 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff" returned: 0 in 0.755s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:40 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff is being set with open permissions: ugo+rw: NotImplementedError Jul 08 02:41:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:40 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff Jul 08 02:41:40 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:41 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff" returned: 0 in 0.763s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:41 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.info Jul 08 02:41:41 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Acquiring lock "cinder-quobyte-10de495c-1dab-43cc-8edf-87a6d5d2684e" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Lock "cinder-quobyte-10de495c-1dab-43cc-8edf-87a6d5d2684e" acquired by "delete_volume" :: waited 0.027s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:42 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd4e2e6-a187-4664-90f5-6e4c7d3d9468]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-10de495c-1dab-43cc-8edf-87a6d5d2684e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:42 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.info" returned: 0 in 1.269s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:42 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 02:41:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:42 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-10de495c-1dab-43cc-8edf-87a6d5d2684e Jul 08 02:41:43 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:43 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.info Jul 08 02:41:43 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:43 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.info" returned: 0 in 0.805s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:43 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.652s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.929s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1541937069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a69901-cd53-4ec2-8ebd-716e7e27dd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93af6c40e5b48e9afc6f0e55c2fe362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:39Z,use_quota=True,user_id='8d7d5160e20a4bb89a8f78e82766a9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:41:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Creating volume b8a69901-cd53-4ec2-8ebd-716e7e27dd7e {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:41:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:41:43 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:41:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-10de495c-1dab-43cc-8edf-87a6d5d2684e" returned: 0 in 1.145s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-10de495c-1dab-43cc-8edf-87a6d5d2684e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:43 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e 1073741824 Jul 08 02:41:43 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:43 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-10de495c-1dab-43cc-8edf-87a6d5d2684e Jul 08 02:41:43 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:44 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-020c64d7-53b2-475b-833e-e0a281d9a266 tempest-GroupSnapshotsTest-910327665 None] group_snapshot 418a46be-9879-41d8-849f-d269758d192d: created successfully Jul 08 02:41:44 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-10de495c-1dab-43cc-8edf-87a6d5d2684e" returned: 0 in 0.786s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:44 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Lock "cinder-quobyte-10de495c-1dab-43cc-8edf-87a6d5d2684e" released by "delete_volume" :: held 2.004s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:44 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Acquiring lock "cinder-quobyte-53b077f5-71ae-434c-8ca5-b709fad1df40" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:44 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Lock "cinder-quobyte-53b077f5-71ae-434c-8ca5-b709fad1df40" acquired by "delete_volume" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:44 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d7ba3e-8170-48ef-ad87-e1dd293108e7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-53b077f5-71ae-434c-8ca5-b709fad1df40 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:44 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-53b077f5-71ae-434c-8ca5-b709fad1df40 Jul 08 02:41:44 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:44 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e 1073741824" returned: 0 in 1.125s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:44 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=138,cinder:UPDATE=142,cinder:INSERT=34,cinder:DELETE=2 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:41:44 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=130,cinder:UPDATE=141,cinder:DELETE=12,cinder:INSERT=28 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:41:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:45 devstack sudo[94128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e Jul 08 02:41:45 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:45 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] group_snapshot 418a46be-9879-41d8-849f-d269758d192d: deleting Jul 08 02:41:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] group_snapshot 418a46be-9879-41d8-849f-d269758d192d: deleting {{(pid=87238) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 02:41:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "cinder-quobyte-f9d0fb5d-f5fe-49ab-a301-92d7db803257" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-f9d0fb5d-f5fe-49ab-a301-92d7db803257" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "cinder-quobyte-19e41632-17e2-4795-bb14-657d458a5bff" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-19e41632-17e2-4795-bb14-657d458a5bff" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] Deleting offline snapshot 19e41632-17e2-4795-bb14-657d458a5bff of volume f9d0fb5d-f5fe-49ab-a301-92d7db803257 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:41:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] snapshot_file for this snap is: volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:41:45 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e296f5e-62f6-415d-8f66-ec71a5667b8e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:45 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff Jul 08 02:41:45 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:45 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-53b077f5-71ae-434c-8ca5-b709fad1df40" returned: 0 in 1.164s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-53b077f5-71ae-434c-8ca5-b709fad1df40 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:45 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-53b077f5-71ae-434c-8ca5-b709fad1df40 Jul 08 02:41:45 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:46 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e" returned: 0 in 1.134s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:46 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] <== create_volume: return (2363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:41:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.368s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:46 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938591c1-d9bb-47de-9170-4a139fc7129d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:46 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d08b26-3874-41e2-8eb2-076704b2e003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:46 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Volume volume-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e (b8a69901-cd53-4ec2-8ebd-716e7e27dd7e): created successfully Jul 08 02:41:46 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d08b26-3874-41e2-8eb2-076704b2e003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:46 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Flow 'volume_create_manager' (da2b303f-393f-41d4-b097-cd09232f127a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:46 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-d1a60ff6-7365-4eb7-a864-4782214a73eb tempest-VolumesTransfersV357Test-2115748314 None] Created volume successfully. Jul 08 02:41:46 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff" returned: 0 in 1.004s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:46 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:41:46 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d26977-5f97-42a6-b736-1dbc45459ded]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:46 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-53b077f5-71ae-434c-8ca5-b709fad1df40" returned: 0 in 0.886s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Lock "cinder-quobyte-53b077f5-71ae-434c-8ca5-b709fad1df40" released by "delete_volume" :: held 2.106s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:46 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 Jul 08 02:41:46 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:46 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Created reservations ['2239dd64-c5c7-41f0-916f-9e29c2a395a9'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:46 devstack cinder-volume[87238]: WARNING cinder.quota [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-532740824 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-532740824, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:41:46 devstack cinder-volume[87238]: WARNING cinder.quota [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-532740824 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-532740824, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:41:46 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Created reservations ['017cd31c-fc09-4c58-b288-db31cc41fca6', '4e31b9c8-767e-45e2-af35-c97cbeed88dd', '2271dac4-5fe8-4f96-8b36-2670e2eda37c', '50618e03-52ff-4d82-bed2-2cd8c232a822'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:47 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Created reservations ['a04c391b-161c-4370-8b6d-7c5868e74b9e', 'b3f5d498-9686-411a-814c-8966a3514fb3', 'd2793cfd-9511-48f2-a2fd-0b7504d7c9cc', '82b4d742-3160-403b-a569-4ba6d889bb15'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:47 devstack sudo[94145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:41:47 devstack sudo[94145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:41:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:47 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:41:47 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:47 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257" returned: 0 in 1.193s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:47 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff Jul 08 02:41:47 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:48 devstack sudo[94145]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.113s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:41:48 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.046s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:41:48 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-52a652a2-2815-4188-ae7a-9ac35e0cefdd tempest-GroupsTest-2036430055 None] Delete group completed successfully. Jul 08 02:41:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:41:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:41:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:41:48 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-35ec51ca-df27-47d2-841b-b53648f39eec tempest-VolumesTransfersV357Test-968675486 None] Transfer volume completed successfully. Jul 08 02:41:48 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff" returned: 0 in 1.110s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:48 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff Jul 08 02:41:48 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:49 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257.19e41632-17e2-4795-bb14-657d458a5bff" returned: 0 in 0.776s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-19e41632-17e2-4795-bb14-657d458a5bff" released by "_delete_snapshot" :: held 4.263s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-f9d0fb5d-f5fe-49ab-a301-92d7db803257" released by "delete_snapshot" :: held 4.312s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:49 devstack cinder-volume[87238]: WARNING cinder.quota [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-739139135 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-739139135, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:41:49 devstack cinder-volume[87238]: WARNING cinder.quota [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-739139135 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-739139135, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:41:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Acquiring lock "cinder-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:49 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] Created reservations ['1a04b7f9-52c1-4a7d-b3bc-dd1255ab7a18', '2930ee06-dc3d-4593-8cda-76cb4c4697c2', '61a6f38f-f623-4cb1-a3bf-9c37a9c3451e', '927e7521-c6c3-4e49-92ec-49b503975cad'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Lock "cinder-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Acquiring lock "cinder-quobyte-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Lock "cinder-quobyte-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e" acquired by "delete_volume" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:50 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[2489846d-baab-4aec-9191-79c21e3b1340]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:50 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0a3ad36d-421f-4b27-a60b-40538375e4e5 tempest-GroupSnapshotsTest-910327665 None] group_snapshot 418a46be-9879-41d8-849f-d269758d192d: deleted successfully Jul 08 02:41:50 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e Jul 08 02:41:50 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:51 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e" returned: 0 in 1.059s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:51 devstack sudo[94199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e Jul 08 02:41:51 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "cinder-quobyte-f9d0fb5d-f5fe-49ab-a301-92d7db803257" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-f9d0fb5d-f5fe-49ab-a301-92d7db803257" acquired by "delete_volume" :: waited 0.035s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:51 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8ae6c3-364e-4b87-8ca3-1d82e4947630]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:51 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 Jul 08 02:41:51 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:51 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e" returned: 0 in 0.778s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Lock "cinder-quobyte-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e" released by "delete_volume" :: held 1.895s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:52 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Created reservations ['f23b66fa-d0a9-419e-bd1a-6d2407a74c56', '83963ee8-5ad2-4612-bd6e-6676828b55e6', '94b88b68-a04c-43d9-9ccf-fc09a26f21ff', '4d8e2a86-d263-4dd7-a794-d34a0f8ab3f5'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:52 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:41:52 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:52 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257" returned: 0 in 1.034s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:52 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257 Jul 08 02:41:52 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Flow 'volume_create_manager' (bc1f1d35-4f37-4131-aa5f-198ee067af96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c084ca-adf0-4b81-b4b0-170fced5d783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c084ca-adf0-4b81-b4b0-170fced5d783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2052021642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ffc789-376a-4bec-8fd9-35cfd573327f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93af6c40e5b48e9afc6f0e55c2fe362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:53Z,use_quota=True,user_id='8d7d5160e20a4bb89a8f78e82766a9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e4c6e8d-50ab-4ce9-8beb-20bf05dc6022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e4c6e8d-50ab-4ce9-8beb-20bf05dc6022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d51170-754b-4cd7-9052-932656b040b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d51170-754b-4cd7-9052-932656b040b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ffc789-376a-4bec-8fd9-35cfd573327f', 'volume_name': 'volume-36ffc789-376a-4bec-8fd9-35cfd573327f', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b830553-8506-4f4c-9439-087cd2c8a540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:53 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b830553-8506-4f4c-9439-087cd2c8a540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f86ef8-2f91-4ae7-b3c9-dff8c5cf667e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:53 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Volume 36ffc789-376a-4bec-8fd9-35cfd573327f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ffc789-376a-4bec-8fd9-35cfd573327f', 'volume_size': 1} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2052021642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ffc789-376a-4bec-8fd9-35cfd573327f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93af6c40e5b48e9afc6f0e55c2fe362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:53Z,use_quota=True,user_id='8d7d5160e20a4bb89a8f78e82766a9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Creating volume 36ffc789-376a-4bec-8fd9-35cfd573327f {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:41:53 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-36ffc789-376a-4bec-8fd9-35cfd573327f 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.124s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:41:53 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Deleted volume successfully. Jul 08 02:41:53 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-36ffc789-376a-4bec-8fd9-35cfd573327f 1073741824 Jul 08 02:41:53 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-71e72d73-0fba-4b9b-9aba-9f9f9fe0bb61 tempest-VolumesTransfersV357Test-1225398983 None] Lock "cinder-b8a69901-cd53-4ec2-8ebd-716e7e27dd7e-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:53 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f9d0fb5d-f5fe-49ab-a301-92d7db803257" returned: 0 in 0.886s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] Lock "cinder-quobyte-f9d0fb5d-f5fe-49ab-a301-92d7db803257" released by "delete_volume" :: held 2.007s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] Created reservations ['60385233-ca94-4d1c-bb46-bb24b74d30ee'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:53 devstack cinder-volume[87238]: WARNING cinder.quota [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-739139135 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-739139135, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] Created reservations ['bdbf6c8f-456f-4348-a6d4-5edd3eae5d2e', 'b6b7af55-7990-43c2-8b90-b1bf8cd590de', '88e53741-b822-4e88-9956-1e83db44454d', '5def51d2-95e0-42a8-939f-f5f05d2925ad'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:53 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:41:53 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:54 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-36ffc789-376a-4bec-8fd9-35cfd573327f 1073741824" returned: 0 in 1.005s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-36ffc789-376a-4bec-8fd9-35cfd573327f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:54 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-36ffc789-376a-4bec-8fd9-35cfd573327f Jul 08 02:41:54 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:54 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.780s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:54 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:41:54 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-20397afa-a426-4af7-81de-8ea7f63743e7 tempest-GroupSnapshotsTest-910327665 None] Delete group completed successfully. Jul 08 02:41:54 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0f50fee5-1bbd-40f2-a962-9e44d34c9d32 tempest-GroupsV314Test-1024685575 None] Group tempest-GroupsV314Test-Group-2085303234: creating Jul 08 02:41:54 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0f50fee5-1bbd-40f2-a962-9e44d34c9d32 tempest-GroupsV314Test-1024685575 None] Group tempest-GroupsV314Test-Group-2085303234: created successfully Jul 08 02:41:54 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0f50fee5-1bbd-40f2-a962-9e44d34c9d32 tempest-GroupsV314Test-1024685575 None] Create group completed successfully. Jul 08 02:41:55 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-36ffc789-376a-4bec-8fd9-35cfd573327f" returned: 0 in 0.818s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:41:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f86ef8-2f91-4ae7-b3c9-dff8c5cf667e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ffc789-376a-4bec-8fd9-35cfd573327f', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18b0bf9-9713-462d-a0e7-0dc19fce8f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:55 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Volume volume-36ffc789-376a-4bec-8fd9-35cfd573327f (36ffc789-376a-4bec-8fd9-35cfd573327f): created successfully Jul 08 02:41:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18b0bf9-9713-462d-a0e7-0dc19fce8f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Flow 'volume_create_manager' (bc1f1d35-4f37-4131-aa5f-198ee067af96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:55 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3e70dd73-3897-4a50-8a31-b220fe28a0dd tempest-VolumesTransfersV357Test-2115748314 None] Created volume successfully. Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Flow 'volume_create_manager' (ef0e71a4-2f5e-4bc4-83dc-5e96720639a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc5f5d7-a176-4bd2-aa9c-e2fd68d1d073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc5f5d7-a176-4bd2-aa9c-e2fd68d1d073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-184931791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cfd9e78b-aadb-4595-beac-a3dbb49be379,host='devstack@QuobyteHD#QuobyteHD',id=733fabda-505f-4379-ad47-16bcb3364174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc127384352b49148efe91076fe9023d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:56Z,use_quota=True,user_id='abccbf03ca4341a6a042817db2f95bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8307b712-bf21-4983-9a35-71ef774acb48),volume_type_id=8307b712-bf21-4983-9a35-71ef774acb48)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d5410d-4319-48ce-a2fa-ae98e0484529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d5410d-4319-48ce-a2fa-ae98e0484529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b7e8a5-251e-42a5-9da6-397d286f76d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b7e8a5-251e-42a5-9da6-397d286f76d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '733fabda-505f-4379-ad47-16bcb3364174', 'volume_name': 'volume-733fabda-505f-4379-ad47-16bcb3364174', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acccc8ed-23b1-4d34-b684-3af2997924e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acccc8ed-23b1-4d34-b684-3af2997924e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32efb4fb-dbe7-43e5-a275-48dd78db78e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:56 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Volume 733fabda-505f-4379-ad47-16bcb3364174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-733fabda-505f-4379-ad47-16bcb3364174', 'volume_size': 1} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cfd9e78b-aadb-4595-beac-a3dbb49be379,created_at=2026-07-08T00:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-184931791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cfd9e78b-aadb-4595-beac-a3dbb49be379,host='devstack@QuobyteHD#QuobyteHD',id=733fabda-505f-4379-ad47-16bcb3364174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc127384352b49148efe91076fe9023d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:41:56Z,use_quota=True,user_id='abccbf03ca4341a6a042817db2f95bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8307b712-bf21-4983-9a35-71ef774acb48),volume_type_id=8307b712-bf21-4983-9a35-71ef774acb48)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Creating volume 733fabda-505f-4379-ad47-16bcb3364174 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:41:56 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:56 devstack sudo[94227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 1073741824 Jul 08 02:41:56 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Acquiring lock "cinder-36ffc789-376a-4bec-8fd9-35cfd573327f-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Lock "cinder-36ffc789-376a-4bec-8fd9-35cfd573327f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Acquiring lock "cinder-quobyte-36ffc789-376a-4bec-8fd9-35cfd573327f" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Lock "cinder-quobyte-36ffc789-376a-4bec-8fd9-35cfd573327f" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[211699ca-81c4-4a58-b688-70496ff50c63]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:41:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-36ffc789-376a-4bec-8fd9-35cfd573327f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:56 devstack sudo[94229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-36ffc789-376a-4bec-8fd9-35cfd573327f Jul 08 02:41:56 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:57 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-36ffc789-376a-4bec-8fd9-35cfd573327f" returned: 0 in 0.926s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-36ffc789-376a-4bec-8fd9-35cfd573327f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:57 devstack sudo[94239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-36ffc789-376a-4bec-8fd9-35cfd573327f Jul 08 02:41:57 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:57 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 1073741824" returned: 0 in 1.210s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:57 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 Jul 08 02:41:57 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:58 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-36ffc789-376a-4bec-8fd9-35cfd573327f" returned: 0 in 0.872s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Lock "cinder-quobyte-36ffc789-376a-4bec-8fd9-35cfd573327f" released by "delete_volume" :: held 1.866s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:41:58 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174" returned: 0 in 0.888s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] <== create_volume: return (2159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:41:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:58 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Created reservations ['5ef4ad47-4546-4404-a956-ba7e7c5fd432', '4cec1573-aef7-4247-9822-33a4722ec423', '272af290-33ec-48b9-9f8c-a4443c8d057e', 'b96e57a2-e731-4f6f-95f1-4e0fc93df38f'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:41:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32efb4fb-dbe7-43e5-a275-48dd78db78e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-733fabda-505f-4379-ad47-16bcb3364174', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f72a1fc-7b9b-410e-ab7a-1e44b5a17db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:41:58 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Volume volume-733fabda-505f-4379-ad47-16bcb3364174 (733fabda-505f-4379-ad47-16bcb3364174): created successfully Jul 08 02:41:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f72a1fc-7b9b-410e-ab7a-1e44b5a17db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:41:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Flow 'volume_create_manager' (ef0e71a4-2f5e-4bc4-83dc-5e96720639a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:41:58 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2f585bde-19bf-4b25-95e3-5b85db06c080 tempest-GroupsV314Test-1024685575 None] Created volume successfully. Jul 08 02:41:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:41:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:41:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:41:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:41:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:41:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:41:59 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:41:59 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:41:59 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Jul 08 02:41:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.858s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:41:59 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:41:59 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Deleted volume successfully. Jul 08 02:41:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-898fa3ae-419b-4068-b019-acc89ef46395 tempest-VolumesTransfersV357Test-1225398983 None] Lock "cinder-36ffc789-376a-4bec-8fd9-35cfd573327f-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:42:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:01 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Cloning volume 733fabda-505f-4379-ad47-16bcb3364174 to volume f2e3f076-2913-42fc-ab95-df7d7b97f886 Jul 08 02:42:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Creating offline snapshot eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 of volume 733fabda-505f-4379-ad47-16bcb3364174 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:42:01 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b84d6e-741c-42b5-9a34-4a94d0878a50]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:01 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 Jul 08 02:42:01 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:02 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174" returned: 0 in 0.996s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:02 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 1G Jul 08 02:42:02 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:03 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 1G" returned: 0 in 1.232s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-733fabda-505f-4379-ad47-16bcb3364174 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:03 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-733fabda-505f-4379-ad47-16bcb3364174 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 Jul 08 02:42:03 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:04 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-733fabda-505f-4379-ad47-16bcb3364174 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124" returned: 0 in 0.812s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:04 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 02:42:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:04 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 Jul 08 02:42:04 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:05 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124" returned: 0 in 0.891s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:05 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.info Jul 08 02:42:05 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:06 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.info" returned: 0 in 0.732s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:06 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 02:42:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:06 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.info Jul 08 02:42:06 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:07 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.info" returned: 0 in 0.918s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Acquiring lock "cinder-quobyte-f2e3f076-2913-42fc-ab95-df7d7b97f886" by "_copy_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Lock "cinder-quobyte-f2e3f076-2913-42fc-ab95-df7d7b97f886" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] snapshot: eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124, volume: f2e3f076-2913-42fc-ab95-df7d7b97f886, {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Flow 'volume_create_manager' (e7fe2e23-d701-440e-b29d-caf745dcc8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec896b4d-ab49-4220-8058-b1a6de932fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0e388e-2776-48b5-a9bf-157cc0c7a1e6]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec896b4d-ab49-4220-8058-b1a6de932fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1012869734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4867357-3235-46f4-a4be-cb834bce96ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181c72f809d041f3b45000ac0968922c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:42:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:42:07Z,use_quota=True,user_id='c3942f5542ca4704bb22eb513a9a6194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edd3e5c-79c0-4451-bcea-c7a99567a9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edd3e5c-79c0-4451-bcea-c7a99567a9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bd3ed0-0009-4762-8056-8cc441461bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bd3ed0-0009-4762-8056-8cc441461bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4867357-3235-46f4-a4be-cb834bce96ea', 'volume_name': 'volume-f4867357-3235-46f4-a4be-cb834bce96ea', 'volume_size': 2}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702afdef-a158-49ac-87a9-ec92d139b713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702afdef-a158-49ac-87a9-ec92d139b713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab26d934-a47c-4c21-a508-ee61a1dc34f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:07 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Volume f4867357-3235-46f4-a4be-cb834bce96ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4867357-3235-46f4-a4be-cb834bce96ea', 'volume_size': 2} Jul 08 02:42:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:07 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 Jul 08 02:42:07 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:08 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124" returned: 0 in 0.867s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-733fabda-505f-4379-ad47-16bcb3364174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:42:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 02:42:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Creating direct copy from snapshot {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 02:42:08 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e13b14-6ca5-4e18-b335-cf45c0639741]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:08 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 Jul 08 02:42:08 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:09 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174" returned: 0 in 0.811s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:09 devstack cinder-volume[87238]: DEBUG cinder.utils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Path /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f2e3f076-2913-42fc-ab95-df7d7b97f886 not found in is_blk_device check {{(pid=87238) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 02:42:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f2e3f076-2913-42fc-ab95-df7d7b97f886 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:09 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f2e3f076-2913-42fc-ab95-df7d7b97f886 Jul 08 02:42:09 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:10 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:42:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Flow 'volume_create_manager' (1d6fcd29-6e06-454e-8553-d3a21aadff19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:42:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7cf56d3-066d-4bc5-a4b2-4786a86f6165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7cf56d3-066d-4bc5-a4b2-4786a86f6165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2092608572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd347cec-3bc9-474d-9aa6-b92d4fdac65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cb419445384d178a74b0885e2a1827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:42:11Z,use_quota=True,user_id='92eb6f1fbe9f448999220335b36ee441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e3b57b-3e21-4e29-9b60-78c3adf3d225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e3b57b-3e21-4e29-9b60-78c3adf3d225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686b4803-b53d-48cf-8bf0-6a8246771eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686b4803-b53d-48cf-8bf0-6a8246771eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd347cec-3bc9-474d-9aa6-b92d4fdac65e', 'volume_name': 'volume-cd347cec-3bc9-474d-9aa6-b92d4fdac65e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3f82f8-a770-4d47-aec8-872880b0a0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3f82f8-a770-4d47-aec8-872880b0a0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1be3a5-5822-474a-aa1d-12ac58ab1643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:10 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Volume cd347cec-3bc9-474d-9aa6-b92d4fdac65e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd347cec-3bc9-474d-9aa6-b92d4fdac65e', 'volume_size': 1} Jul 08 02:42:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:15 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f2e3f076-2913-42fc-ab95-df7d7b97f886" returned: 0 in 6.532s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:15 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[07622f22-eebe-439f-93ad-0bdf8cd39568]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:15 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 Jul 08 02:42:15 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:16 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174" returned: 0 in 1.005s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:16 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f2e3f076-2913-42fc-ab95-df7d7b97f886 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:42:16 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Converted 1024.00 MB image at 156.72 MB/s Jul 08 02:42:16 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f2e3f076-2913-42fc-ab95-df7d7b97f886 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 02:42:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f2e3f076-2913-42fc-ab95-df7d7b97f886 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:16 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f2e3f076-2913-42fc-ab95-df7d7b97f886 Jul 08 02:42:16 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:17 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f2e3f076-2913-42fc-ab95-df7d7b97f886" returned: 0 in 0.645s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Lock "cinder-quobyte-f2e3f076-2913-42fc-ab95-df7d7b97f886" released by "_copy_volume_from_snapshot" :: held 9.997s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:42:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Acquiring lock "cinder-quobyte-eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:42:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Lock "cinder-quobyte-eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:42:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Deleting offline snapshot eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 of volume 733fabda-505f-4379-ad47-16bcb3364174 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:42:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] snapshot_file for this snap is: volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:42:17 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[735d1c7f-2f2c-401b-b6e9-2d4a1f1817c0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:17 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 Jul 08 02:42:17 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:18 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124" returned: 0 in 0.782s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-733fabda-505f-4379-ad47-16bcb3364174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:42:18 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e51c95-78f1-4a0f-ace5-52d9f40250ba]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:18 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 Jul 08 02:42:18 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:19 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174" returned: 0 in 0.829s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:19 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 Jul 08 02:42:19 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:19 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124" returned: 0 in 0.788s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:19 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124 Jul 08 02:42:19 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:20 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174.eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124" returned: 0 in 0.679s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Lock "cinder-quobyte-eb4914aa-0bd0-40ac-98b0-d1a5e7f7b124" released by "_delete_snapshot" :: held 3.190s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:42:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.051s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.096s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1012869734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4867357-3235-46f4-a4be-cb834bce96ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181c72f809d041f3b45000ac0968922c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:42:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:42:07Z,use_quota=True,user_id='c3942f5542ca4704bb22eb513a9a6194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:42:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Creating volume f4867357-3235-46f4-a4be-cb834bce96ea {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:42:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:42:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:42:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:42:20 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:42:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f4867357-3235-46f4-a4be-cb834bce96ea 2147483648 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:20 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f4867357-3235-46f4-a4be-cb834bce96ea 2147483648 Jul 08 02:42:20 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:20 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-93494682-bb36-45a7-b97b-3f876905e90a tempest-GroupsV314Test-1024685575 None] Create group from source-group-cfd9e78b-aadb-4595-beac-a3dbb49be379 completed successfully. Jul 08 02:42:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Acquiring lock "cinder-quobyte-f2e3f076-2913-42fc-ab95-df7d7b97f886" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:42:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Lock "cinder-quobyte-f2e3f076-2913-42fc-ab95-df7d7b97f886" acquired by "delete_volume" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:42:21 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab4ed99-195f-4b7b-a520-2b144cd30b9b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f2e3f076-2913-42fc-ab95-df7d7b97f886 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:21 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f4867357-3235-46f4-a4be-cb834bce96ea 2147483648" returned: 0 in 0.946s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f4867357-3235-46f4-a4be-cb834bce96ea {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:21 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f4867357-3235-46f4-a4be-cb834bce96ea Jul 08 02:42:21 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:21 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f2e3f076-2913-42fc-ab95-df7d7b97f886 Jul 08 02:42:21 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:22 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f4867357-3235-46f4-a4be-cb834bce96ea" returned: 0 in 0.704s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.379s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2092608572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd347cec-3bc9-474d-9aa6-b92d4fdac65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cb419445384d178a74b0885e2a1827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:42:11Z,use_quota=True,user_id='92eb6f1fbe9f448999220335b36ee441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Creating volume cd347cec-3bc9-474d-9aa6-b92d4fdac65e {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:42:22 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cd347cec-3bc9-474d-9aa6-b92d4fdac65e 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:22 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f2e3f076-2913-42fc-ab95-df7d7b97f886" returned: 0 in 0.806s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f2e3f076-2913-42fc-ab95-df7d7b97f886 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:22 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cd347cec-3bc9-474d-9aa6-b92d4fdac65e 1073741824 Jul 08 02:42:22 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab26d934-a47c-4c21-a508-ee61a1dc34f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4867357-3235-46f4-a4be-cb834bce96ea', 'volume_size': 2}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68f05d1-83e3-40d7-857c-3a7dbacb3374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:22 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f2e3f076-2913-42fc-ab95-df7d7b97f886 Jul 08 02:42:22 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:22 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Volume volume-f4867357-3235-46f4-a4be-cb834bce96ea (f4867357-3235-46f4-a4be-cb834bce96ea): created successfully Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68f05d1-83e3-40d7-857c-3a7dbacb3374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Flow 'volume_create_manager' (e7fe2e23-d701-440e-b29d-caf745dcc8ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:42:22 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-cd2b2224-d584-475c-9981-3917672ec414 tempest-VolumesCloneNegativeTest-1374290299 None] Created volume successfully. Jul 08 02:42:23 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f2e3f076-2913-42fc-ab95-df7d7b97f886" returned: 0 in 0.749s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Lock "cinder-quobyte-f2e3f076-2913-42fc-ab95-df7d7b97f886" released by "delete_volume" :: held 1.613s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Created reservations ['09cfa79f-de1f-4120-b24b-4d1f25cd146f'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Acquiring lock "cinder-f4867357-3235-46f4-a4be-cb834bce96ea-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Lock "cinder-f4867357-3235-46f4-a4be-cb834bce96ea-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:42:23 devstack cinder-volume[87238]: WARNING cinder.quota [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1252902372 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1252902372, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:42:23 devstack cinder-volume[87238]: WARNING cinder.quota [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1252902372 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1252902372, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Created reservations ['9fadebd2-640f-4757-a32e-4cfbb4306989', '4fcc5250-de0f-4955-a765-b0501e390885', '9e983e6b-0aba-42f5-a886-e3d89e492512', 'dcdabb77-82b4-40b3-9902-f93353a2babf'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Acquiring lock "cinder-quobyte-f4867357-3235-46f4-a4be-cb834bce96ea" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Lock "cinder-quobyte-f4867357-3235-46f4-a4be-cb834bce96ea" acquired by "delete_volume" :: waited 0.032s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:42:23 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f71ae95-7578-45d8-a3e4-8b88129a89c5]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f4867357-3235-46f4-a4be-cb834bce96ea {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cd347cec-3bc9-474d-9aa6-b92d4fdac65e 1073741824" returned: 0 in 1.145s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cd347cec-3bc9-474d-9aa6-b92d4fdac65e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:42:23 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cd347cec-3bc9-474d-9aa6-b92d4fdac65e Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:23 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:23 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:42:23 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:23 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f4867357-3235-46f4-a4be-cb834bce96ea Jul 08 02:42:23 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] Acquiring lock "cinder-quobyte-733fabda-505f-4379-ad47-16bcb3364174" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:42:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] Lock "cinder-quobyte-733fabda-505f-4379-ad47-16bcb3364174" acquired by "delete_volume" :: waited 0.043s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:42:24 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:24 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9e449d-26df-4ae4-8d0b-e08bb40fa810]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cd347cec-3bc9-474d-9aa6-b92d4fdac65e" returned: 0 in 0.975s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] <== create_volume: return (2193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:42:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.202s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1be3a5-5822-474a-aa1d-12ac58ab1643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd347cec-3bc9-474d-9aa6-b92d4fdac65e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2364aecd-aac4-4d06-8ba7-39b5832a74d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:24 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Volume volume-cd347cec-3bc9-474d-9aa6-b92d4fdac65e (cd347cec-3bc9-474d-9aa6-b92d4fdac65e): created successfully Jul 08 02:42:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2364aecd-aac4-4d06-8ba7-39b5832a74d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Flow 'volume_create_manager' (1d6fcd29-6e06-454e-8553-d3a21aadff19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:42:24 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a7952651-0255-472e-8318-8ac86d223215 tempest-VolumeQuotasAdminTestJSON-624337465 None] Created volume successfully. Jul 08 02:42:24 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.068s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:24 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:42:24 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-35e7847d-b026-4adf-b27d-adce6ca8f388 tempest-GroupsV314Test-1024685575 None] Delete group completed successfully. Jul 08 02:42:24 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 Jul 08 02:42:24 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:24 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f4867357-3235-46f4-a4be-cb834bce96ea" returned: 0 in 1.444s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f4867357-3235-46f4-a4be-cb834bce96ea {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:24 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f4867357-3235-46f4-a4be-cb834bce96ea Jul 08 02:42:24 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Acquiring lock "cinder-cd347cec-3bc9-474d-9aa6-b92d4fdac65e-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:42:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Lock "cinder-cd347cec-3bc9-474d-9aa6-b92d4fdac65e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:42:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Acquiring lock "cinder-quobyte-cd347cec-3bc9-474d-9aa6-b92d4fdac65e" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:42:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Lock "cinder-quobyte-cd347cec-3bc9-474d-9aa6-b92d4fdac65e" acquired by "delete_volume" :: waited 0.039s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:42:25 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[8257d0ec-9c6c-41fb-bc26-03c1fd723916]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cd347cec-3bc9-474d-9aa6-b92d4fdac65e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:25 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cd347cec-3bc9-474d-9aa6-b92d4fdac65e Jul 08 02:42:25 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:25 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f4867357-3235-46f4-a4be-cb834bce96ea" returned: 0 in 1.013s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Lock "cinder-quobyte-f4867357-3235-46f4-a4be-cb834bce96ea" released by "delete_volume" :: held 2.528s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:42:25 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174" returned: 0 in 1.471s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:25 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174 Jul 08 02:42:25 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:25 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Created reservations ['ff0b2428-0fca-4c5b-a711-6d5ae87c25d9', 'edde2783-aef4-4989-b642-c35eb19c2829', 'da00292a-9595-4f22-81f9-12664221d82d', 'f67ca273-2088-4cc8-9781-f80a7febc543'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:42:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:42:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:42:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:26 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:42:26 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:26 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cd347cec-3bc9-474d-9aa6-b92d4fdac65e" returned: 0 in 1.008s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cd347cec-3bc9-474d-9aa6-b92d4fdac65e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:26 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cd347cec-3bc9-474d-9aa6-b92d4fdac65e Jul 08 02:42:26 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:26 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-733fabda-505f-4379-ad47-16bcb3364174" returned: 0 in 0.866s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:26 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] Lock "cinder-quobyte-733fabda-505f-4379-ad47-16bcb3364174" released by "delete_volume" :: held 2.453s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:42:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.786s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:26 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:42:26 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Deleted volume successfully. Jul 08 02:42:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a590d507-f744-4814-ad4d-10b52939b042 tempest-VolumesCloneNegativeTest-1374290299 None] Lock "cinder-f4867357-3235-46f4-a4be-cb834bce96ea-delete_volume" released by "delete_volume" :: held 3.620s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:42:26 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] Created reservations ['22794637-79c5-4414-8dd9-204dacf910f7'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:42:27 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] Created reservations ['24fa83e7-61b7-4d2a-9686-a07b444e8897', '0bc84eb2-7c09-49a9-828d-e9cfddf4a002', '426f7b43-6bea-460e-bd5e-d3f5fbd7be5a', '99ca10ab-f549-442a-9d04-fc1fadf399d6'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:42:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:42:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:42:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:27 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:42:27 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:27 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cd347cec-3bc9-474d-9aa6-b92d4fdac65e" returned: 0 in 0.753s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Lock "cinder-quobyte-cd347cec-3bc9-474d-9aa6-b92d4fdac65e" released by "delete_volume" :: held 1.828s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:42:27 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Created reservations ['0b31ab95-b753-4f0b-b949-aa38983186ee', '72693551-57db-486b-bd74-32120bfed137', '851dbedc-9849-4b1d-bf49-941a8cc3fef7', 'aa53f83e-3666-4208-a47b-080f99a65d70'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:42:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:42:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:42:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:27 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:42:27 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:28 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.993s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:42:28 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-16567a4b-a95b-4a18-bdf3-a3f19316b80d tempest-GroupsV314Test-1024685575 None] Delete group completed successfully. Jul 08 02:42:28 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.880s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:42:28 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Deleted volume successfully. Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dfec111f-b8bd-4958-ae6c-81f2b10089a4 tempest-VolumeQuotasAdminTestJSON-624337465 None] Lock "cinder-cd347cec-3bc9-474d-9aa6-b92d4fdac65e-delete_volume" released by "delete_volume" :: held 3.008s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Flow 'volume_create_manager' (fc8e5a89-a523-4b76-a0cf-abcf02d44115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8b84a4-e9eb-4eb6-a118-c847c0a20c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8b84a4-e9eb-4eb6-a118-c847c0a20c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-599415493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376a4948-10da-442a-9562-fc371810d184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cb419445384d178a74b0885e2a1827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:42:28Z,use_quota=True,user_id='92eb6f1fbe9f448999220335b36ee441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97b8704-a3f9-4e10-aa81-b8a931746b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97b8704-a3f9-4e10-aa81-b8a931746b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd8b319-b0fa-4593-a6fe-10c406b4e212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd8b319-b0fa-4593-a6fe-10c406b4e212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376a4948-10da-442a-9562-fc371810d184', 'volume_name': 'volume-376a4948-10da-442a-9562-fc371810d184', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40112ff3-1e5d-4b70-ad92-c7308e66b4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40112ff3-1e5d-4b70-ad92-c7308e66b4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e368900a-5d35-4508-8536-9131659fe498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:28 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Volume 376a4948-10da-442a-9562-fc371810d184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376a4948-10da-442a-9562-fc371810d184', 'volume_size': 1} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-599415493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376a4948-10da-442a-9562-fc371810d184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cb419445384d178a74b0885e2a1827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:42:28Z,use_quota=True,user_id='92eb6f1fbe9f448999220335b36ee441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Creating volume 376a4948-10da-442a-9562-fc371810d184 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:42:28 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:42:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-376a4948-10da-442a-9562-fc371810d184 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:28 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-376a4948-10da-442a-9562-fc371810d184 1073741824 Jul 08 02:42:28 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:29 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-376a4948-10da-442a-9562-fc371810d184 1073741824" returned: 0 in 1.282s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-376a4948-10da-442a-9562-fc371810d184 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:29 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-376a4948-10da-442a-9562-fc371810d184 Jul 08 02:42:29 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:30 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-376a4948-10da-442a-9562-fc371810d184" returned: 0 in 0.967s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] <== create_volume: return (2362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:42:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.364s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e368900a-5d35-4508-8536-9131659fe498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376a4948-10da-442a-9562-fc371810d184', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c50ab6b-e92f-4c6a-84f2-e3d52dff4eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:30 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Volume volume-376a4948-10da-442a-9562-fc371810d184 (376a4948-10da-442a-9562-fc371810d184): created successfully Jul 08 02:42:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c50ab6b-e92f-4c6a-84f2-e3d52dff4eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Flow 'volume_create_manager' (fc8e5a89-a523-4b76-a0cf-abcf02d44115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:42:31 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c5b2a2ba-a4f5-431a-a09e-dab72755c64f tempest-VolumeQuotasAdminTestJSON-624337465 None] Created volume successfully. Jul 08 02:42:31 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:42:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Flow 'volume_create_manager' (61f7ee1d-3a47-43fb-945c-a6a3ae17323e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:42:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9caea4c-ae4c-457c-a75b-0a34409f9fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9caea4c-ae4c-457c-a75b-0a34409f9fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1237954786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91a9f17f8b4829bf67df4e22aada1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:42:32Z,use_quota=True,user_id='c6dfb42cb9924de4b751accbdcf3299d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bccb089-1825-4e6f-a541-a9da3d7f663b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bccb089-1825-4e6f-a541-a9da3d7f663b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adc3424-2a2b-4342-85bb-3f470f10e01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:31 devstack cinder-volume[87238]: DEBUG cinder.image.glance [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Creating Keystone auth plugin from conf {{(pid=87238) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 02:42:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adc3424-2a2b-4342-85bb-3f470f10e01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018', 'volume_name': 'volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018', 'volume_size': 1, 'image_id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a21b7084cd94a8dbdfabbb9ed31db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'created_at': datetime.datetime(2026, 7, 8, 0, 29, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 29, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d652479-1a49-4785-9fa6-62d5f48b409f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46efe604-145f-4bc4-b4c8-2ade94ad5e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46efe604-145f-4bc4-b4c8-2ade94ad5e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdd0fc8-aa9b-42b7-b776-c71d9fb62264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:32 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Volume 8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018', 'volume_size': 1, 'image_id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a21b7084cd94a8dbdfabbb9ed31db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'created_at': datetime.datetime(2026, 7, 8, 0, 29, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 29, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d652479-1a49-4785-9fa6-62d5f48b409f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 02:42:32 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Trying to clone 8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 from image 9d652479-1a49-4785-9fa6-62d5f48b409f at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}]). {{(pid=87238) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 02:42:32 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_l463k4csdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 02:42:32 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Image download 20.69 MB at 20.69 MB/s Jul 08 02:42:32 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[41913083-b845-4950-8112-a2fb9365971f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_l463k4csdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:32 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-09faf742-62d3-46c4-88bc-5bc3fbdbc20f tempest-VolumeQuotasAdminTestJSON-1510673931 None] Transfer volume completed successfully. Jul 08 02:42:33 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_l463k4csdevstack@QuobyteHD Jul 08 02:42:33 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:34 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_l463k4csdevstack@QuobyteHD" returned: 0 in 1.095s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:34 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Temporary image 9d652479-1a49-4785-9fa6-62d5f48b409f is fetched for user c6dfb42cb9924de4b751accbdcf3299d. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 02:42:34 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[36db2360-6f4e-46b2-afed-0fc0484e4f8f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_l463k4csdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Acquiring lock "cinder-376a4948-10da-442a-9562-fc371810d184-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:42:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Lock "cinder-376a4948-10da-442a-9562-fc371810d184-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:42:34 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_l463k4csdevstack@QuobyteHD Jul 08 02:42:34 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Acquiring lock "cinder-quobyte-376a4948-10da-442a-9562-fc371810d184" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:42:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Lock "cinder-quobyte-376a4948-10da-442a-9562-fc371810d184" acquired by "delete_volume" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:42:34 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ff8fd5-a60f-4c4b-a8dd-eaaa4d010637]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-376a4948-10da-442a-9562-fc371810d184 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:34 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-376a4948-10da-442a-9562-fc371810d184 Jul 08 02:42:34 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:35 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_l463k4csdevstack@QuobyteHD" returned: 0 in 1.059s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1237954786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91a9f17f8b4829bf67df4e22aada1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:42:32Z,use_quota=True,user_id='c6dfb42cb9924de4b751accbdcf3299d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:42:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Creating volume 8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:42:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:42:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:42:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:42:35 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:42:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:35 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 1073741824 Jul 08 02:42:35 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:35 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-376a4948-10da-442a-9562-fc371810d184" returned: 0 in 1.374s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-376a4948-10da-442a-9562-fc371810d184 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:35 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-376a4948-10da-442a-9562-fc371810d184 Jul 08 02:42:35 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:36 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 1073741824" returned: 0 in 1.490s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:36 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 Jul 08 02:42:36 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:36 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-376a4948-10da-442a-9562-fc371810d184" returned: 0 in 1.034s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Lock "cinder-quobyte-376a4948-10da-442a-9562-fc371810d184" released by "delete_volume" :: held 2.489s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:42:37 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Created reservations ['4c971977-9ded-48cc-b102-3d6bdfab94d6', '302a7f41-8394-4880-a09d-a55d6b4312db', '2aff9bae-53fc-4d15-aaed-db0716d34fc5', 'fb28f72b-5350-4002-b83f-00ea68e823a1'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:42:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:42:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:42:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:37 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:42:37 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:38 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018" returned: 0 in 1.352s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] <== create_volume: return (2929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:42:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.932s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:38 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Attempting download of 9d652479-1a49-4785-9fa6-62d5f48b409f ((None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}])) to volume 8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 02:42:38 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[08615617-1ba5-4ec5-b550-27942ca24bb7]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_n6_kg8gk {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:38 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_n6_kg8gk Jul 08 02:42:38 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:38 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.398s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:38 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:42:38 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Deleted volume successfully. Jul 08 02:42:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff99a658-03d6-4380-aea2-104a683fcc9e tempest-VolumeQuotasAdminTestJSON-1659934165 None] Lock "cinder-376a4948-10da-442a-9562-fc371810d184-delete_volume" released by "delete_volume" :: held 4.368s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:42:39 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_n6_kg8gk" returned: 0 in 1.324s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_n6_kg8gk {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:39 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_n6_kg8gk Jul 08 02:42:39 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:40 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_n6_kg8gk" returned: 1 in 1.084s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_n6_kg8gk' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:42:40 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[35444f31-2ee3-4c9d-a0e6-edb35bb8f703]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_l463k4csdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:40 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_l463k4csdevstack@QuobyteHD Jul 08 02:42:40 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:41 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_l463k4csdevstack@QuobyteHD" returned: 0 in 1.067s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:41 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] 9d652479-1a49-4785-9fa6-62d5f48b409f was qcow2, converting to raw {{(pid=87238) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 02:42:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_l463k4csdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:41 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_l463k4csdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 Jul 08 02:42:41 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:44 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_l463k4csdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018" returned: 0 in 3.128s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:44 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_l463k4csdevstack@QuobyteHD, size 112.00 MB, duration 3.13 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:42:44 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Converted 112.00 MB image at 35.78 MB/s Jul 08 02:42:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:44 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 1G Jul 08 02:42:44 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:46 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 1G" returned: 0 in 1.205s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:46 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[872a4ccb-7af8-4dca-8c40-f68137e20df1]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:46 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 Jul 08 02:42:46 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:47 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018" returned: 0 in 0.987s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:42:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:42:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:42:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:47 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:42:47 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:47 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 Jul 08 02:42:47 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:48 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018" returned: 1 in 0.997s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Downloaded image 9d652479-1a49-4785-9fa6-62d5f48b409f ((None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}])) to volume 8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 successfully. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Temporary image 9d652479-1a49-4785-9fa6-62d5f48b409f for user c6dfb42cb9924de4b751accbdcf3299d is deleted. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Marking volume 8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 as bootable. {{(pid=87238) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=90,cinder:INSERT=26,cinder:UPDATE=129,cinder:DELETE=6 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=95,cinder:UPDATE=115,cinder:INSERT=32,cinder:DELETE=5 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Copying metadata from image 9d652479-1a49-4785-9fa6-62d5f48b409f to 8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018. {{(pid=87238) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Creating volume glance metadata for volume 8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 backed by image 9d652479-1a49-4785-9fa6-62d5f48b409f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87238) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 02:42:48 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.997s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdd0fc8-aa9b-42b7-b776-c71d9fb62264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018', 'volume_size': 1, 'image_id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a21b7084cd94a8dbdfabbb9ed31db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'created_at': datetime.datetime(2026, 7, 8, 0, 29, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 29, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d652479-1a49-4785-9fa6-62d5f48b409f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ac0bc0-792c-451d-b871-80bcb31961f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:48 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Volume volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 (8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018): created successfully Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ac0bc0-792c-451d-b871-80bcb31961f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Flow 'volume_create_manager' (61f7ee1d-3a47-43fb-945c-a6a3ae17323e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:42:48 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a258b532-a447-41a8-ac79-187243a10945 tempest-VolumesExtendTest-662399568 None] Created volume successfully. Jul 08 02:42:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2b1aaa43-ddce-456c-9f8f-cf9bfa0f9475 tempest-VolumesExtendTest-662399568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2b1aaa43-ddce-456c-9f8f-cf9bfa0f9475 tempest-VolumesExtendTest-662399568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:49 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa8c3d7-2288-49b9-ab23-eaef27e87179]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2b1aaa43-ddce-456c-9f8f-cf9bfa0f9475 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:49 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:42:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Flow 'volume_create_manager' (255b2c6a-ff61-4f26-9d5b-0813b86f1bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:42:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5233618a-0712-4499-9322-2eacd673c223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5233618a-0712-4499-9322-2eacd673c223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-882087021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b7b790-c712-4bae-ac92-39bd1565f8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b7b3d364a54d3a8c0476109079b24b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:42:50Z,use_quota=True,user_id='215036ed4adb4bff9b677582e11d82f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b4960e-46d1-4d37-a30d-4d810e1320ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b4960e-46d1-4d37-a30d-4d810e1320ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:49 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 Jul 08 02:42:49 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c3a833-da7e-46e2-9123-a8063d9484f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c3a833-da7e-46e2-9123-a8063d9484f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3b7b790-c712-4bae-ac92-39bd1565f8cb', 'volume_name': 'volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b85fc2-081f-4c8e-ba0e-c7a846a6ef0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b85fc2-081f-4c8e-ba0e-c7a846a6ef0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a356e3a-0013-4b73-a06a-6b6eff612c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:49 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Volume a3b7b790-c712-4bae-ac92-39bd1565f8cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb', 'volume_size': 1} Jul 08 02:42:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:50 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2b1aaa43-ddce-456c-9f8f-cf9bfa0f9475 tempest-VolumesExtendTest-662399568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018" returned: 0 in 0.967s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2b1aaa43-ddce-456c-9f8f-cf9bfa0f9475 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:50 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 Jul 08 02:42:50 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:51 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2b1aaa43-ddce-456c-9f8f-cf9bfa0f9475 tempest-VolumesExtendTest-662399568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018" returned: 1 in 1.087s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2b1aaa43-ddce-456c-9f8f-cf9bfa0f9475 tempest-VolumesExtendTest-662399568 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2b1aaa43-ddce-456c-9f8f-cf9bfa0f9475 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 2G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Flow 'volume_create_manager' (cbd8143e-8c65-4a27-af58-826f9a82643f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dab3b54-72ba-48e2-a522-8f06e510502a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dab3b54-72ba-48e2-a522-8f06e510502a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-732598008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a65cdd-de1b-44d9-86e5-6b5f174adfe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8dee97912143a295800e23c9df60a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:42:52Z,use_quota=True,user_id='a679ae74403a4f05b2d29a3b9f95e45f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42338851-b06c-4d21-98ae-15d09ed12d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42338851-b06c-4d21-98ae-15d09ed12d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6732332b-ac9e-40e7-8929-7dd00d7a5e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6732332b-ac9e-40e7-8929-7dd00d7a5e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93a65cdd-de1b-44d9-86e5-6b5f174adfe3', 'volume_name': 'volume-93a65cdd-de1b-44d9-86e5-6b5f174adfe3', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c30218-9867-443d-be83-e820ca09d97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c30218-9867-443d-be83-e820ca09d97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d048b70a-acf0-431d-9503-1fb89af4532c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:51 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Volume 93a65cdd-de1b-44d9-86e5-6b5f174adfe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93a65cdd-de1b-44d9-86e5-6b5f174adfe3', 'volume_size': 1} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2b1aaa43-ddce-456c-9f8f-cf9bfa0f9475 tempest-VolumesExtendTest-662399568 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 2G" returned: 0 in 0.133s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2b1aaa43-ddce-456c-9f8f-cf9bfa0f9475 tempest-VolumesExtendTest-662399568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.238s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.046s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-882087021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b7b790-c712-4bae-ac92-39bd1565f8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b7b3d364a54d3a8c0476109079b24b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:42:50Z,use_quota=True,user_id='215036ed4adb4bff9b677582e11d82f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Creating volume a3b7b790-c712-4bae-ac92-39bd1565f8cb {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:42:51 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:42:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:51 devstack sudo[94698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb 1073741824 Jul 08 02:42:51 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:51 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2b1aaa43-ddce-456c-9f8f-cf9bfa0f9475 tempest-VolumesExtendTest-662399568 None] Extend volume completed successfully. Jul 08 02:42:52 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb 1073741824" returned: 0 in 0.954s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:52 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb Jul 08 02:42:52 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Acquiring lock "cinder-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Lock "cinder-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Acquiring lock "cinder-quobyte-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Lock "cinder-quobyte-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018" acquired by "delete_volume" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9b545b-0f42-4fb9-93c6-a83dee5a5794]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:53 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 Jul 08 02:42:53 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:53 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb" returned: 0 in 0.786s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.798s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-732598008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a65cdd-de1b-44d9-86e5-6b5f174adfe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8dee97912143a295800e23c9df60a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:42:52Z,use_quota=True,user_id='a679ae74403a4f05b2d29a3b9f95e45f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Creating volume 93a65cdd-de1b-44d9-86e5-6b5f174adfe3 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:42:53 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93a65cdd-de1b-44d9-86e5-6b5f174adfe3 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a356e3a-0013-4b73-a06a-6b6eff612c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:53 devstack sudo[94721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93a65cdd-de1b-44d9-86e5-6b5f174adfe3 1073741824 Jul 08 02:42:53 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8d598c-f2f2-4994-b467-0e667adf2b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:53 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Volume volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb (a3b7b790-c712-4bae-ac92-39bd1565f8cb): created successfully Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8d598c-f2f2-4994-b467-0e667adf2b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Flow 'volume_create_manager' (255b2c6a-ff61-4f26-9d5b-0813b86f1bc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:42:53 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ee7a9bb0-66c1-42cd-8ffc-42a08d26c89e tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Created volume successfully. Jul 08 02:42:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:54 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018" returned: 0 in 1.066s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:54 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 Jul 08 02:42:54 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:54 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93a65cdd-de1b-44d9-86e5-6b5f174adfe3 1073741824" returned: 0 in 1.238s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93a65cdd-de1b-44d9-86e5-6b5f174adfe3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:55 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93a65cdd-de1b-44d9-86e5-6b5f174adfe3 Jul 08 02:42:55 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:55 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018" returned: 1 in 1.088s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:42:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:55 devstack sudo[94738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018 Jul 08 02:42:55 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:55 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93a65cdd-de1b-44d9-86e5-6b5f174adfe3" returned: 0 in 0.797s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:42:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.569s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d048b70a-acf0-431d-9503-1fb89af4532c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a65cdd-de1b-44d9-86e5-6b5f174adfe3', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1578f61-530a-4af2-8874-c0b62a1d35b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Creating offline snapshot 01537198-2669-4a2b-ba20-c687cf1367eb of volume a3b7b790-c712-4bae-ac92-39bd1565f8cb {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:42:55 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Volume volume-93a65cdd-de1b-44d9-86e5-6b5f174adfe3 (93a65cdd-de1b-44d9-86e5-6b5f174adfe3): created successfully Jul 08 02:42:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1578f61-530a-4af2-8874-c0b62a1d35b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Flow 'volume_create_manager' (cbd8143e-8c65-4a27-af58-826f9a82643f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:42:55 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72f2ec4-6ad8-4b39-9b9b-9d009e204b3b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:55 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2a810270-7617-4c35-901a-f11fccd87806 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Created volume successfully. Jul 08 02:42:56 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb Jul 08 02:42:56 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:56 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018" returned: 0 in 0.807s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Lock "cinder-quobyte-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018" released by "delete_volume" :: held 3.070s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:42:56 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Created reservations ['c0e09e6b-744f-4886-8fdd-7b0ebd53c722', '78dfcbb4-d2bb-41be-98e3-586f73a9adfd', 'face077b-39a9-4f78-aa0f-7cb018176dca', 'b9a1fcf0-6d20-4f86-b162-defa9f913b46'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:42:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:42:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:42:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:56 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:42:56 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:57 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb" returned: 0 in 1.265s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:57 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb 1G Jul 08 02:42:57 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Flow 'volume_create_manager' (770eee19-2dcb-4699-8c21-5e91e73a6782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962da74e-ce36-4cab-99b2-fdc689da41e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962da74e-ce36-4cab-99b2-fdc689da41e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1316933511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7249ff17-1a54-4cf6-8af8-7e6845eda0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91a9f17f8b4829bf67df4e22aada1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:42:57Z,use_quota=True,user_id='c6dfb42cb9924de4b751accbdcf3299d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4aec30-fdff-4238-a1be-873c39e13aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4aec30-fdff-4238-a1be-873c39e13aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4fae7d-8b29-4e8d-ad91-6b621a1d66da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4fae7d-8b29-4e8d-ad91-6b621a1d66da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7249ff17-1a54-4cf6-8af8-7e6845eda0ae', 'volume_name': 'volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7d3bbc-b582-44ce-b375-7a7e37050196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7d3bbc-b582-44ce-b375-7a7e37050196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533832f9-c0fb-42f8-9fee-9bdb8374176a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:42:57 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Volume 7249ff17-1a54-4cf6-8af8-7e6845eda0ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae', 'volume_size': 1} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:57 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.148s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:42:57 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Deleted volume successfully. Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-47be8ec9-64e7-4e8e-86a9-6f5fcd5c8bf5 tempest-VolumesExtendTest-662399568 None] Lock "cinder-8ddf6cf1-5a9c-4bc1-83ee-16d3968a0018-delete_volume" released by "delete_volume" :: held 4.509s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Acquiring lock "cinder-93a65cdd-de1b-44d9-86e5-6b5f174adfe3-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Lock "cinder-93a65cdd-de1b-44d9-86e5-6b5f174adfe3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Acquiring lock "cinder-quobyte-93a65cdd-de1b-44d9-86e5-6b5f174adfe3" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Lock "cinder-quobyte-93a65cdd-de1b-44d9-86e5-6b5f174adfe3" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dc037f-afe1-470a-b5d5-372f926b5ca0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:42:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93a65cdd-de1b-44d9-86e5-6b5f174adfe3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:57 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93a65cdd-de1b-44d9-86e5-6b5f174adfe3 Jul 08 02:42:57 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:58 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb 1G" returned: 0 in 1.240s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:58 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb Jul 08 02:42:58 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:58 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93a65cdd-de1b-44d9-86e5-6b5f174adfe3" returned: 0 in 0.874s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93a65cdd-de1b-44d9-86e5-6b5f174adfe3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:58 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93a65cdd-de1b-44d9-86e5-6b5f174adfe3 Jul 08 02:42:58 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:59 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb" returned: 0 in 0.722s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:59 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb is being set with open permissions: ugo+rw Jul 08 02:42:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:59 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb Jul 08 02:42:59 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:59 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93a65cdd-de1b-44d9-86e5-6b5f174adfe3" returned: 0 in 0.762s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Lock "cinder-quobyte-93a65cdd-de1b-44d9-86e5-6b5f174adfe3" released by "delete_volume" :: held 1.689s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:42:59 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Created reservations ['81a43e6e-3b0b-448c-bd43-5e98000050be', '79f1a636-8704-4848-aeda-18fefb0ed71a', '0bd52044-7f6a-4d6b-b141-ab3c37d1cb1c', '11f567b8-ff4d-405b-9748-480adbf469f2'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:42:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:42:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:42:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:42:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:42:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:42:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:59 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:42:59 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:42:59 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Jul 08 02:42:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb" returned: 0 in 0.735s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:42:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:42:59 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.info Jul 08 02:42:59 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:00 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.677s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:00 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:43:00 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Deleted volume successfully. Jul 08 02:43:00 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2efc1963-b760-4ee2-b1b9-5426fec47a13 tempest-VolumeQuotasNegativeTestJSON-565219899 None] Lock "cinder-93a65cdd-de1b-44d9-86e5-6b5f174adfe3-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:00 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.info" returned: 0 in 0.751s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:00 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.info is being set with open permissions: ugo+rw Jul 08 02:43:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:00 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.info Jul 08 02:43:00 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:01 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.info" returned: 0 in 0.677s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.559s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.815s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1316933511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7249ff17-1a54-4cf6-8af8-7e6845eda0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91a9f17f8b4829bf67df4e22aada1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:42:57Z,use_quota=True,user_id='c6dfb42cb9924de4b751accbdcf3299d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:43:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Creating volume 7249ff17-1a54-4cf6-8af8-7e6845eda0ae {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:43:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:43:01 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:43:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:01 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae 1073741824 Jul 08 02:43:01 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:01 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-60982779-bf68-4000-85ce-d44433f5a893 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Create snapshot completed successfully Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Acquiring lock "cinder-01537198-2669-4a2b-ba20-c687cf1367eb-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "cinder-01537198-2669-4a2b-ba20-c687cf1367eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Acquiring lock "cinder-quobyte-a3b7b790-c712-4bae-ac92-39bd1565f8cb" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "cinder-quobyte-a3b7b790-c712-4bae-ac92-39bd1565f8cb" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Acquiring lock "cinder-quobyte-01537198-2669-4a2b-ba20-c687cf1367eb" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "cinder-quobyte-01537198-2669-4a2b-ba20-c687cf1367eb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Deleting offline snapshot 01537198-2669-4a2b-ba20-c687cf1367eb of volume a3b7b790-c712-4bae-ac92-39bd1565f8cb {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] snapshot_file for this snap is: volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bb3887-2cee-4fca-a655-2695ec9c9626]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:02 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae 1073741824" returned: 0 in 1.220s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:02 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb Jul 08 02:43:02 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:02 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae Jul 08 02:43:02 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Flow 'volume_create_manager' (b1ea609b-32a0-451e-9136-801376ccf6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cff7007-81a2-4fdb-9299-1fd6f4b9f3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cff7007-81a2-4fdb-9299-1fd6f4b9f3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1835744531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4515eabe-61bf-4b42-8a53-8bf3f601214f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8b316d5d5d49a6906abc78448e2254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:03Z,use_quota=True,user_id='8b43205c4002465086c25db7d78c413c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de86776-c72f-4a33-97ef-921020fcd964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de86776-c72f-4a33-97ef-921020fcd964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db25685-45c6-4a46-8055-6099363d2d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db25685-45c6-4a46-8055-6099363d2d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4515eabe-61bf-4b42-8a53-8bf3f601214f', 'volume_name': 'volume-4515eabe-61bf-4b42-8a53-8bf3f601214f', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c218c4-642d-4f27-966b-919f9428dcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c218c4-642d-4f27-966b-919f9428dcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9254a45-a522-4513-b476-bf429b00b951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:03 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Volume 4515eabe-61bf-4b42-8a53-8bf3f601214f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4515eabe-61bf-4b42-8a53-8bf3f601214f', 'volume_size': 1} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:03 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb" returned: 0 in 1.013s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feb130c-d5cb-4ea0-9619-8a068c72a5c3]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:03 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae" returned: 0 in 0.859s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.522s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1835744531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4515eabe-61bf-4b42-8a53-8bf3f601214f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8b316d5d5d49a6906abc78448e2254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:03Z,use_quota=True,user_id='8b43205c4002465086c25db7d78c413c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Creating volume 4515eabe-61bf-4b42-8a53-8bf3f601214f {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:43:03 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4515eabe-61bf-4b42-8a53-8bf3f601214f 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:03 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4515eabe-61bf-4b42-8a53-8bf3f601214f 1073741824 Jul 08 02:43:03 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533832f9-c0fb-42f8-9fee-9bdb8374176a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dec82c6-81bc-4974-810a-4f2bfa6eb580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:03 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Volume volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae (7249ff17-1a54-4cf6-8af8-7e6845eda0ae): created successfully Jul 08 02:43:03 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb Jul 08 02:43:03 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dec82c6-81bc-4974-810a-4f2bfa6eb580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Flow 'volume_create_manager' (770eee19-2dcb-4699-8c21-5e91e73a6782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:03 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-15f38da2-4109-45ef-b69f-8fa99a942435 tempest-VolumesExtendTest-662399568 None] Created volume successfully. Jul 08 02:43:04 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb" returned: 0 in 0.820s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:04 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb Jul 08 02:43:04 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:04 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4515eabe-61bf-4b42-8a53-8bf3f601214f 1073741824" returned: 0 in 0.916s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4515eabe-61bf-4b42-8a53-8bf3f601214f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:04 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4515eabe-61bf-4b42-8a53-8bf3f601214f Jul 08 02:43:04 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:05 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb" returned: 0 in 0.895s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:05 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb Jul 08 02:43:05 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:05 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4515eabe-61bf-4b42-8a53-8bf3f601214f" returned: 0 in 0.752s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.225s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] Creating offline snapshot 162c580f-ccb5-45fc-b659-e9b5756419c1 of volume 7249ff17-1a54-4cf6-8af8-7e6845eda0ae {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9254a45-a522-4513-b476-bf429b00b951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4515eabe-61bf-4b42-8a53-8bf3f601214f', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e9a1f6-5ba1-47ee-8e2a-9dfbccda58ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[585c26eb-9aaa-44a7-abf4-5b5bfdea944e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:05 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Volume volume-4515eabe-61bf-4b42-8a53-8bf3f601214f (4515eabe-61bf-4b42-8a53-8bf3f601214f): created successfully Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e9a1f6-5ba1-47ee-8e2a-9dfbccda58ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Flow 'volume_create_manager' (b1ea609b-32a0-451e-9136-801376ccf6d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:05 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-688ea6ef-2f09-4de6-9034-893bc5e5e34a tempest-ServersNegativeTestJSON-1758072407 None] Created volume successfully. Jul 08 02:43:05 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae Jul 08 02:43:05 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:05 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb.01537198-2669-4a2b-ba20-c687cf1367eb" returned: 0 in 0.690s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "cinder-quobyte-01537198-2669-4a2b-ba20-c687cf1367eb" released by "_delete_snapshot" :: held 3.554s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "cinder-quobyte-a3b7b790-c712-4bae-ac92-39bd1565f8cb" released by "delete_snapshot" :: held 3.588s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Created reservations ['682ee115-e30f-4691-9135-ebc6ae9c3da9', '2a7fc5cd-5d29-4ced-941b-c37d0c636c58', 'adec7981-9b3b-4a59-aa56-23ea34589ba4', '8130f9db-4088-413b-923b-b49acece9f84'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Flow 'volume_create_manager' (aa095502-9f8b-45c7-ac83-68e7d0d733bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4818cc-0acb-4216-bf62-68474b66eebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4818cc-0acb-4216-bf62-68474b66eebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-8113221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7635090d-4224-4f89-9754-d6ee68fc9ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38538d8362449d288d5a8840eb0769e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:06Z,use_quota=True,user_id='8a7a256dac1a4fc3a36c25021c9387ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49e9b0b4-828c-43ed-aa83-97fdff03e734),volume_type_id=49e9b0b4-828c-43ed-aa83-97fdff03e734)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b466242-be7e-4e25-9852-fcb88e178d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b466242-be7e-4e25-9852-fcb88e178d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8473bb1-3d62-49ed-b1c2-9aaa3f54f6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8473bb1-3d62-49ed-b1c2-9aaa3f54f6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7635090d-4224-4f89-9754-d6ee68fc9ed8', 'volume_name': 'volume-7635090d-4224-4f89-9754-d6ee68fc9ed8', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9b4ae9-9a4f-4026-89ab-abb31401f684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:06 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9b4ae9-9a4f-4026-89ab-abb31401f684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be92f656-af85-4159-b10b-52266091a3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:06 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Volume 7635090d-4224-4f89-9754-d6ee68fc9ed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7635090d-4224-4f89-9754-d6ee68fc9ed8', 'volume_size': 1} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae" returned: 0 in 0.891s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:06 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Delete snapshot completed successfully. Jul 08 02:43:06 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 1G Jul 08 02:43:06 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7b683b11-6c59-45fe-bb8f-f7503ca7a9e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "cinder-01537198-2669-4a2b-ba20-c687cf1367eb-delete_snapshot" released by "delete_snapshot" :: held 3.885s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Acquiring lock "cinder-a3b7b790-c712-4bae-ac92-39bd1565f8cb-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "cinder-a3b7b790-c712-4bae-ac92-39bd1565f8cb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Acquiring lock "cinder-quobyte-a3b7b790-c712-4bae-ac92-39bd1565f8cb" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "cinder-quobyte-a3b7b790-c712-4bae-ac92-39bd1565f8cb" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f2af85-f05d-4823-9b16-7983dd0a0094]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:06 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb Jul 08 02:43:06 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:07 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 1G" returned: 0 in 0.869s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:07 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 Jul 08 02:43:07 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Flow 'volume_create_manager' (9de09297-c5d1-4a18-aefe-08b9a1fee87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c45120c-e161-49e1-b701-20b591c3c5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c45120c-e161-49e1-b701-20b591c3c5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-793024279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8b316d5d5d49a6906abc78448e2254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:07Z,use_quota=True,user_id='8b43205c4002465086c25db7d78c413c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f571f2-a817-42ac-b726-8106e519b8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f571f2-a817-42ac-b726-8106e519b8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8aa37ce-02dd-4693-a51c-ff5a8dfb4489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8aa37ce-02dd-4693-a51c-ff5a8dfb4489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75', 'volume_name': 'volume-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b66ba2af-8516-40ab-990e-d2fa96b9c25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b66ba2af-8516-40ab-990e-d2fa96b9c25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fe309e-270f-4ed2-b20f-c7546152096a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:07 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Volume 0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75', 'volume_size': 1} Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:07 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb" returned: 0 in 0.808s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:07 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb Jul 08 02:43:07 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:07 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1" returned: 0 in 0.761s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:07 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 is being set with open permissions: ugo+rw Jul 08 02:43:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:07 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 Jul 08 02:43:07 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:08 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a3b7b790-c712-4bae-ac92-39bd1565f8cb" returned: 0 in 0.651s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "cinder-quobyte-a3b7b790-c712-4bae-ac92-39bd1565f8cb" released by "delete_volume" :: held 1.513s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:08 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Created reservations ['4346779c-c7ff-42e8-9a84-5f180a6d1c20', '77e5cb54-f373-4194-aab4-04066938ddb0', '2b1b7464-7fdb-4fe5-bd11-de5547935fd6', '78b9d7d3-d459-42ce-9a77-471cf38cbbf3'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:43:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:08 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:43:08 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:08 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1" returned: 0 in 0.671s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:08 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.info Jul 08 02:43:08 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:09 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.675s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:43:09 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Deleted volume successfully. Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bbb1d798-5702-41c1-93e4-1f70620b8e70 tempest-VolumeSnapshotQuotasNegativeTestJSON-967539307 None] Lock "cinder-a3b7b790-c712-4bae-ac92-39bd1565f8cb-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:09 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.info" returned: 0 in 0.717s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:09 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.info is being set with open permissions: ugo+rw Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:09 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.info Jul 08 02:43:09 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:09 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.info" returned: 0 in 0.687s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.696s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.778s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-8113221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7635090d-4224-4f89-9754-d6ee68fc9ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38538d8362449d288d5a8840eb0769e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:06Z,use_quota=True,user_id='8a7a256dac1a4fc3a36c25021c9387ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49e9b0b4-828c-43ed-aa83-97fdff03e734),volume_type_id=49e9b0b4-828c-43ed-aa83-97fdff03e734)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Creating volume 7635090d-4224-4f89-9754-d6ee68fc9ed8 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:43:09 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:43:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7635090d-4224-4f89-9754-d6ee68fc9ed8 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:10 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7635090d-4224-4f89-9754-d6ee68fc9ed8 1073741824 Jul 08 02:43:10 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:10 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f9726755-39c0-48e2-aa76-c4ce32daea96 tempest-VolumesExtendTest-662399568 None] Create snapshot completed successfully Jul 08 02:43:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-519b706f-85ca-4fc4-a282-c514518cd342 tempest-VolumesExtendTest-662399568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:10 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7635090d-4224-4f89-9754-d6ee68fc9ed8 1073741824" returned: 0 in 0.911s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7635090d-4224-4f89-9754-d6ee68fc9ed8 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:10 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7635090d-4224-4f89-9754-d6ee68fc9ed8 Jul 08 02:43:10 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:11 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7635090d-4224-4f89-9754-d6ee68fc9ed8" returned: 0 in 0.728s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.125s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-793024279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8b316d5d5d49a6906abc78448e2254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:07Z,use_quota=True,user_id='8b43205c4002465086c25db7d78c413c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Creating volume 0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:43:11 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be92f656-af85-4159-b10b-52266091a3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7635090d-4224-4f89-9754-d6ee68fc9ed8', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:11 devstack sudo[94888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75 1073741824 Jul 08 02:43:11 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56786cc-c599-4ad7-875f-f2a0e237c6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:11 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Volume volume-7635090d-4224-4f89-9754-d6ee68fc9ed8 (7635090d-4224-4f89-9754-d6ee68fc9ed8): created successfully Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56786cc-c599-4ad7-875f-f2a0e237c6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Flow 'volume_create_manager' (aa095502-9f8b-45c7-ac83-68e7d0d733bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:11 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b72e0043-b963-4807-9e99-82be82dd6feb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Created volume successfully. Jul 08 02:43:12 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75 1073741824" returned: 0 in 0.947s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:12 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75 Jul 08 02:43:12 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d2a6b668-85e1-4813-9775-69f4a63c014b tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d2a6b668-85e1-4813-9775-69f4a63c014b tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:12 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d2a6b668-85e1-4813-9775-69f4a63c014b tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:12 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d2a6b668-85e1-4813-9775-69f4a63c014b tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d2a6b668-85e1-4813-9775-69f4a63c014b tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d2a6b668-85e1-4813-9775-69f4a63c014b tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:12 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:43:12 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:13 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75" returned: 0 in 0.701s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:43:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-519b706f-85ca-4fc4-a282-c514518cd342 tempest-VolumesExtendTest-662399568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.995s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fe309e-270f-4ed2-b20f-c7546152096a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720051df-8d16-4d22-9a07-424cd50e8d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:13 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[2165c7b4-71f6-4b76-bd70-b984f8071564]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-519b706f-85ca-4fc4-a282-c514518cd342 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:13 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Volume volume-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75 (0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75): created successfully Jul 08 02:43:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720051df-8d16-4d22-9a07-424cd50e8d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Flow 'volume_create_manager' (9de09297-c5d1-4a18-aefe-08b9a1fee87e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:13 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-866a9908-5034-4eea-bde7-71a03016aa65 tempest-ServersNegativeTestJSON-1758072407 None] Created volume successfully. Jul 08 02:43:13 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae Jul 08 02:43:13 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:13 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d2a6b668-85e1-4813-9775-69f4a63c014b tempest-VolumeRetypeWithoutMigrationTest-133218157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.798s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:13 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-d2a6b668-85e1-4813-9775-69f4a63c014b tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:43:13 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-d2a6b668-85e1-4813-9775-69f4a63c014b tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Retype volume completed successfully. Jul 08 02:43:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Acquiring lock "cinder-7635090d-4224-4f89-9754-d6ee68fc9ed8-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Lock "cinder-7635090d-4224-4f89-9754-d6ee68fc9ed8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Acquiring lock "cinder-quobyte-7635090d-4224-4f89-9754-d6ee68fc9ed8" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:14 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Lock "cinder-quobyte-7635090d-4224-4f89-9754-d6ee68fc9ed8" acquired by "delete_volume" :: waited 0.047s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-519b706f-85ca-4fc4-a282-c514518cd342 tempest-VolumesExtendTest-662399568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae" returned: 0 in 1.037s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-519b706f-85ca-4fc4-a282-c514518cd342 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 2G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:14 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e6fa5b-a54c-435e-949d-9a6fbba27f42]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7635090d-4224-4f89-9754-d6ee68fc9ed8 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Acquiring lock "cinder-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Lock "cinder-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Acquiring lock "cinder-quobyte-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Lock "cinder-quobyte-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75" acquired by "delete_volume" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:14 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7635090d-4224-4f89-9754-d6ee68fc9ed8 Jul 08 02:43:14 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:14 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[826f3fff-bcc7-49f7-b5cf-1b22248233a8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-519b706f-85ca-4fc4-a282-c514518cd342 tempest-VolumesExtendTest-662399568 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 2G" returned: 0 in 0.421s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-519b706f-85ca-4fc4-a282-c514518cd342 tempest-VolumesExtendTest-662399568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.512s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:14 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-519b706f-85ca-4fc4-a282-c514518cd342 tempest-VolumesExtendTest-662399568 None] Extend volume completed successfully. Jul 08 02:43:15 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75 Jul 08 02:43:15 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:15 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7635090d-4224-4f89-9754-d6ee68fc9ed8" returned: 0 in 1.147s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7635090d-4224-4f89-9754-d6ee68fc9ed8 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:15 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7635090d-4224-4f89-9754-d6ee68fc9ed8 Jul 08 02:43:15 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:15 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75" returned: 0 in 0.904s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:15 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75 Jul 08 02:43:15 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Acquiring lock "cinder-162c580f-ccb5-45fc-b659-e9b5756419c1-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Lock "cinder-162c580f-ccb5-45fc-b659-e9b5756419c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Acquiring lock "cinder-quobyte-7249ff17-1a54-4cf6-8af8-7e6845eda0ae" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Lock "cinder-quobyte-7249ff17-1a54-4cf6-8af8-7e6845eda0ae" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Acquiring lock "cinder-quobyte-162c580f-ccb5-45fc-b659-e9b5756419c1" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Lock "cinder-quobyte-162c580f-ccb5-45fc-b659-e9b5756419c1" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Deleting offline snapshot 162c580f-ccb5-45fc-b659-e9b5756419c1 of volume 7249ff17-1a54-4cf6-8af8-7e6845eda0ae {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] snapshot_file for this snap is: volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc21772d-2c87-4f31-81c7-381e824e4ee8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:16 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 Jul 08 02:43:16 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:16 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7635090d-4224-4f89-9754-d6ee68fc9ed8" returned: 0 in 0.791s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Lock "cinder-quobyte-7635090d-4224-4f89-9754-d6ee68fc9ed8" released by "delete_volume" :: held 2.027s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:16 devstack cinder-volume[87238]: WARNING cinder.quota [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:43:16 devstack cinder-volume[87238]: WARNING cinder.quota [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Created reservations ['06a31c92-0551-45ba-9ced-2d98b6bbfd9c', 'b043b8ff-da72-4d88-aa79-a3e32a368144', 'b7f8c36d-6206-4781-b67f-cfc057465c03', 'cc501071-d4a3-4dbe-beb0-a56d509c2566'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:16 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75" returned: 0 in 0.839s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Lock "cinder-quobyte-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75" released by "delete_volume" :: held 1.813s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:16 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:43:16 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Created reservations ['a726312c-7ddf-4651-9264-0d41dc0a79d7', '38d4f097-ab01-47cb-9539-2519ae42da1b', 'e328fc83-0149-4cbc-91a6-e0a397f47205', '9109e807-d4d4-40bd-8934-d8ae81a8e92d'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:16 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:43:16 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:17 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1" returned: 0 in 1.004s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:43:17 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4882eb9-a602-449f-8081-33d3b7ed8301]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:17 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae Jul 08 02:43:17 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:17 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.867s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:17 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:43:17 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Deleted volume successfully. Jul 08 02:43:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-80406932-9786-43da-9b64-f5b460f3ccbb tempest-VolumeRetypeWithoutMigrationTest-133218157 None] Lock "cinder-7635090d-4224-4f89-9754-d6ee68fc9ed8-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:17 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.753s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:17 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:43:17 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Deleted volume successfully. Jul 08 02:43:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8b7669dd-2def-4387-a16e-e3d095fbc7d1 tempest-ServersNegativeTestJSON-1758072407 None] Lock "cinder-0bb9b95f-c602-4ecc-b6b5-0bc5a16cdd75-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Acquiring lock "cinder-4515eabe-61bf-4b42-8a53-8bf3f601214f-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Lock "cinder-4515eabe-61bf-4b42-8a53-8bf3f601214f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Acquiring lock "cinder-quobyte-4515eabe-61bf-4b42-8a53-8bf3f601214f" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Lock "cinder-quobyte-4515eabe-61bf-4b42-8a53-8bf3f601214f" acquired by "delete_volume" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:18 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a065a3-14a9-4919-86f3-75a836ef9907]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4515eabe-61bf-4b42-8a53-8bf3f601214f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:18 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae" returned: 0 in 0.940s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:18 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 Jul 08 02:43:18 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:18 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4515eabe-61bf-4b42-8a53-8bf3f601214f Jul 08 02:43:18 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:19 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4515eabe-61bf-4b42-8a53-8bf3f601214f" returned: 0 in 0.970s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4515eabe-61bf-4b42-8a53-8bf3f601214f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:19 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4515eabe-61bf-4b42-8a53-8bf3f601214f Jul 08 02:43:19 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:19 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1" returned: 0 in 1.025s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:19 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1 Jul 08 02:43:19 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:19 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4515eabe-61bf-4b42-8a53-8bf3f601214f" returned: 0 in 0.808s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Lock "cinder-quobyte-4515eabe-61bf-4b42-8a53-8bf3f601214f" released by "delete_volume" :: held 1.850s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Created reservations ['d4e2bd97-3648-4a75-8bde-5795d6983ecc', '8a872791-06c5-4a6d-bf21-091ecc8818c0', '1a792730-acc1-48db-bbc1-ac74a280c5fe', 'e11e990b-cad3-44c6-a2cb-c45de5eb3932'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:43:20 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae.162c580f-ccb5-45fc-b659-e9b5756419c1" returned: 0 in 0.885s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Lock "cinder-quobyte-162c580f-ccb5-45fc-b659-e9b5756419c1" released by "_delete_snapshot" :: held 4.020s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Lock "cinder-quobyte-7249ff17-1a54-4cf6-8af8-7e6845eda0ae" released by "delete_snapshot" :: held 4.076s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:20 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:43:20 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Created reservations ['1caaa34f-3c1d-4b06-a400-c358a6c4f20f', '1e7ff222-3341-4e70-bd4c-5b06bd4646e7', '4a379016-7837-4bdf-a8e9-33e3544d08b2', '9fe05acc-34f6-4643-b09a-dfc0df5953a5'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Flow 'volume_create_manager' (3d06f301-fcd1-495f-a6e6-f472210f8d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e8f74e-7cab-47c9-8e02-f16e1e248cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e8f74e-7cab-47c9-8e02-f16e1e248cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-280898926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33840906-b6c0-474b-8e80-9c6130da0827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aef294f51274c628ae94120c9af6dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:20Z,use_quota=True,user_id='2e144d2831e645719abe8c0f13edca60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4349d327-b416-4256-8c31-78d999cbb3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4349d327-b416-4256-8c31-78d999cbb3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288a870b-1dc5-4bc0-9138-b458e317a747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288a870b-1dc5-4bc0-9138-b458e317a747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33840906-b6c0-474b-8e80-9c6130da0827', 'volume_name': 'volume-33840906-b6c0-474b-8e80-9c6130da0827', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c017294-9afb-4974-a286-f17dea949ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c017294-9afb-4974-a286-f17dea949ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (270a7a51-60f0-4447-b7a6-1775820520b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:20 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Volume 33840906-b6c0-474b-8e80-9c6130da0827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33840906-b6c0-474b-8e80-9c6130da0827', 'volume_size': 1} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-280898926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33840906-b6c0-474b-8e80-9c6130da0827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aef294f51274c628ae94120c9af6dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:20Z,use_quota=True,user_id='2e144d2831e645719abe8c0f13edca60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Creating volume 33840906-b6c0-474b-8e80-9c6130da0827 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:43:20 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-33840906-b6c0-474b-8e80-9c6130da0827 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:20 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Delete snapshot completed successfully. Jul 08 02:43:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32fd226d-8222-407b-b4fe-6c9775d634f0 tempest-VolumesExtendTest-662399568 None] Lock "cinder-162c580f-ccb5-45fc-b659-e9b5756419c1-delete_snapshot" released by "delete_snapshot" :: held 4.522s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:20 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-33840906-b6c0-474b-8e80-9c6130da0827 1073741824 Jul 08 02:43:20 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:21 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.944s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:21 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:43:21 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Deleted volume successfully. Jul 08 02:43:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-07c5783c-298d-4e78-ad8d-6d8969cd3228 tempest-ServersNegativeTestJSON-1758072407 None] Lock "cinder-4515eabe-61bf-4b42-8a53-8bf3f601214f-delete_volume" released by "delete_volume" :: held 3.245s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Acquiring lock "cinder-7249ff17-1a54-4cf6-8af8-7e6845eda0ae-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Lock "cinder-7249ff17-1a54-4cf6-8af8-7e6845eda0ae-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Acquiring lock "cinder-quobyte-7249ff17-1a54-4cf6-8af8-7e6845eda0ae" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Lock "cinder-quobyte-7249ff17-1a54-4cf6-8af8-7e6845eda0ae" acquired by "delete_volume" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:21 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-33840906-b6c0-474b-8e80-9c6130da0827 1073741824" returned: 0 in 1.109s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:21 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc7581a-c24f-4942-b689-d0f8409c0810]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-33840906-b6c0-474b-8e80-9c6130da0827 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:21 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-33840906-b6c0-474b-8e80-9c6130da0827 Jul 08 02:43:21 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:21 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae Jul 08 02:43:21 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:22 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-33840906-b6c0-474b-8e80-9c6130da0827" returned: 0 in 0.772s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:43:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (270a7a51-60f0-4447-b7a6-1775820520b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33840906-b6c0-474b-8e80-9c6130da0827', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628ae526-ea1c-4eca-b944-709b02cc5b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:22 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Volume volume-33840906-b6c0-474b-8e80-9c6130da0827 (33840906-b6c0-474b-8e80-9c6130da0827): created successfully Jul 08 02:43:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628ae526-ea1c-4eca-b944-709b02cc5b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Flow 'volume_create_manager' (3d06f301-fcd1-495f-a6e6-f472210f8d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:22 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae" returned: 0 in 0.886s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:22 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ae125e14-e8cc-4d26-9841-ab5e3f6792c8 tempest-VolumesMetadataTest-1786069784 None] Created volume successfully. Jul 08 02:43:22 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae Jul 08 02:43:22 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:23 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7249ff17-1a54-4cf6-8af8-7e6845eda0ae" returned: 0 in 0.793s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Lock "cinder-quobyte-7249ff17-1a54-4cf6-8af8-7e6845eda0ae" released by "delete_volume" :: held 1.752s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:23 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Created reservations ['8ab55eec-90f0-4339-8f70-1007411b2183', '85759080-ad16-4a10-8751-df5b2eca246d', '21c5c325-e649-4fd4-80f7-a41f9d144c9f', '8ccec6af-951e-4883-87d2-9dcaab4c384c'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:43:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:23 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:43:23 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:24 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.999s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:24 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:43:24 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Deleted volume successfully. Jul 08 02:43:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Acquiring lock "cinder-33840906-b6c0-474b-8e80-9c6130da0827-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Lock "cinder-33840906-b6c0-474b-8e80-9c6130da0827-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-515d4570-7a85-4341-a519-6bb1b723fafb tempest-VolumesExtendTest-662399568 None] Lock "cinder-7249ff17-1a54-4cf6-8af8-7e6845eda0ae-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Acquiring lock "cinder-quobyte-33840906-b6c0-474b-8e80-9c6130da0827" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Lock "cinder-quobyte-33840906-b6c0-474b-8e80-9c6130da0827" acquired by "delete_volume" :: waited 0.014s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:24 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[3506da54-1c95-4dbd-86e3-97d0844fea29]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-33840906-b6c0-474b-8e80-9c6130da0827 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:24 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-33840906-b6c0-474b-8e80-9c6130da0827 Jul 08 02:43:24 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:25 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-33840906-b6c0-474b-8e80-9c6130da0827" returned: 0 in 0.917s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-33840906-b6c0-474b-8e80-9c6130da0827 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:25 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-33840906-b6c0-474b-8e80-9c6130da0827 Jul 08 02:43:25 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:26 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-33840906-b6c0-474b-8e80-9c6130da0827" returned: 0 in 0.807s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Lock "cinder-quobyte-33840906-b6c0-474b-8e80-9c6130da0827" released by "delete_volume" :: held 1.788s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:26 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Created reservations ['1fa24a6d-9671-4799-890b-1fb60b4942ee', '9cc8ea72-1d77-4fcb-973d-970774f6e34a', 'c2882960-0506-4d58-88f4-e935a6172fef', 'b1f39de4-8d7e-44e9-a641-6d06ff4fa6bb'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:43:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:26 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:43:26 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:27 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.969s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:27 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:43:27 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Deleted volume successfully. Jul 08 02:43:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f70276fd-b63e-443a-909a-360f6c2b5a5a tempest-VolumesMetadataTest-1786069784 None] Lock "cinder-33840906-b6c0-474b-8e80-9c6130da0827-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Flow 'volume_create_manager' (6c82f0dc-549c-4456-8438-fcc01d2942d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e335011-bed9-4931-b64b-7a847a3e5bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e335011-bed9-4931-b64b-7a847a3e5bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1745154936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc7568b-fc96-400b-b90e-11ad4a569dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378efc8dc17b4b8bb27116d71597f2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:29Z,use_quota=True,user_id='6f03a887bc584f13bc660bf6be006da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad11073e-ad8f-4abd-be45-53db73547e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad11073e-ad8f-4abd-be45-53db73547e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be01c51-a776-4054-9de3-f40d53ef8cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be01c51-a776-4054-9de3-f40d53ef8cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dc7568b-fc96-400b-b90e-11ad4a569dfd', 'volume_name': 'volume-3dc7568b-fc96-400b-b90e-11ad4a569dfd', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d344c1d-5824-46d6-8933-89b9ae89d9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d344c1d-5824-46d6-8933-89b9ae89d9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9e2637-b408-4765-9128-5f1a5eb89b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:29 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Volume 3dc7568b-fc96-400b-b90e-11ad4a569dfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dc7568b-fc96-400b-b90e-11ad4a569dfd', 'volume_size': 1} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1745154936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc7568b-fc96-400b-b90e-11ad4a569dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378efc8dc17b4b8bb27116d71597f2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:29Z,use_quota=True,user_id='6f03a887bc584f13bc660bf6be006da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Creating volume 3dc7568b-fc96-400b-b90e-11ad4a569dfd {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:43:29 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:43:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3dc7568b-fc96-400b-b90e-11ad4a569dfd 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:29 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3dc7568b-fc96-400b-b90e-11ad4a569dfd 1073741824 Jul 08 02:43:29 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:30 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3dc7568b-fc96-400b-b90e-11ad4a569dfd 1073741824" returned: 0 in 1.085s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3dc7568b-fc96-400b-b90e-11ad4a569dfd {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:30 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3dc7568b-fc96-400b-b90e-11ad4a569dfd Jul 08 02:43:30 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:31 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3dc7568b-fc96-400b-b90e-11ad4a569dfd" returned: 0 in 0.948s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:43:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9e2637-b408-4765-9128-5f1a5eb89b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dc7568b-fc96-400b-b90e-11ad4a569dfd', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8f577b-a38c-46b4-8410-8a947ef766b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:31 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Volume volume-3dc7568b-fc96-400b-b90e-11ad4a569dfd (3dc7568b-fc96-400b-b90e-11ad4a569dfd): created successfully Jul 08 02:43:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8f577b-a38c-46b4-8410-8a947ef766b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Flow 'volume_create_manager' (6c82f0dc-549c-4456-8438-fcc01d2942d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:31 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5bf5994c-91ff-465a-a6c7-c730645ea6df tempest-ProjectReaderTests-1604143971 None] Created volume successfully. Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Flow 'volume_create_manager' (f94b1653-cade-4e45-9c6b-ccff50edf423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7dadc8e-2ad8-4c58-9d84-8b8325bb03bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7dadc8e-2ad8-4c58-9d84-8b8325bb03bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1912224337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281b640d-ca12-4e66-898c-a829af223fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed9844355b64db78afd08af35b7438e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:32Z,use_quota=True,user_id='635afa53f0cb475cb63bb4981354efac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f486a0dc-840c-40ab-8fba-e41cb7b371f6),volume_type_id=f486a0dc-840c-40ab-8fba-e41cb7b371f6)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214d387e-3169-4973-bd8a-73f7455384b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214d387e-3169-4973-bd8a-73f7455384b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411bd3a0-4a62-4451-9048-ada4e90041f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411bd3a0-4a62-4451-9048-ada4e90041f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '281b640d-ca12-4e66-898c-a829af223fae', 'volume_name': 'volume-281b640d-ca12-4e66-898c-a829af223fae', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44821c1d-cb77-4155-af93-300e2d7ba495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44821c1d-cb77-4155-af93-300e2d7ba495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d78efdf-e33a-40af-ac2d-750a25c1a9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:32 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Volume 281b640d-ca12-4e66-898c-a829af223fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-281b640d-ca12-4e66-898c-a829af223fae', 'volume_size': 1} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1912224337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281b640d-ca12-4e66-898c-a829af223fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed9844355b64db78afd08af35b7438e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:32Z,use_quota=True,user_id='635afa53f0cb475cb63bb4981354efac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f486a0dc-840c-40ab-8fba-e41cb7b371f6),volume_type_id=f486a0dc-840c-40ab-8fba-e41cb7b371f6)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Creating volume 281b640d-ca12-4e66-898c-a829af223fae {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:43:32 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-281b640d-ca12-4e66-898c-a829af223fae 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:32 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-281b640d-ca12-4e66-898c-a829af223fae 1073741824 Jul 08 02:43:32 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Flow 'volume_create_manager' (9c09d500-acbd-482f-aef0-dd1f0621f201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997f4a47-2634-4b71-8811-4e86fe71db15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Acquiring lock "cinder-3dc7568b-fc96-400b-b90e-11ad4a569dfd-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997f4a47-2634-4b71-8811-4e86fe71db15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1819756584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35eb3dca-547a-4124-98b1-17ef3afc77a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82f64bb795348098aea628c0a691b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:33Z,use_quota=True,user_id='29844cb3afd4438e8f0e7d42103cb86b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8618676f-8987-4be6-b585-d749138b6ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8618676f-8987-4be6-b585-d749138b6ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b96e7f1-bcac-4bfd-a1c6-0515960bce24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b96e7f1-bcac-4bfd-a1c6-0515960bce24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35eb3dca-547a-4124-98b1-17ef3afc77a4', 'volume_name': 'volume-35eb3dca-547a-4124-98b1-17ef3afc77a4', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d6d6f5-897b-49b4-bec3-1a60504dd910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d6d6f5-897b-49b4-bec3-1a60504dd910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60baccb8-853d-46ee-892f-9ff1c6bc4b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:32 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Volume 35eb3dca-547a-4124-98b1-17ef3afc77a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35eb3dca-547a-4124-98b1-17ef3afc77a4', 'volume_size': 1} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Lock "cinder-3dc7568b-fc96-400b-b90e-11ad4a569dfd-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Acquiring lock "cinder-quobyte-3dc7568b-fc96-400b-b90e-11ad4a569dfd" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Lock "cinder-quobyte-3dc7568b-fc96-400b-b90e-11ad4a569dfd" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb5e6f3-d966-4635-bc37-b869bb0553af]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3dc7568b-fc96-400b-b90e-11ad4a569dfd {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:32 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3dc7568b-fc96-400b-b90e-11ad4a569dfd Jul 08 02:43:32 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:33 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-281b640d-ca12-4e66-898c-a829af223fae 1073741824" returned: 0 in 1.109s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-281b640d-ca12-4e66-898c-a829af223fae {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:33 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-281b640d-ca12-4e66-898c-a829af223fae Jul 08 02:43:33 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:33 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3dc7568b-fc96-400b-b90e-11ad4a569dfd" returned: 0 in 0.885s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3dc7568b-fc96-400b-b90e-11ad4a569dfd {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:33 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3dc7568b-fc96-400b-b90e-11ad4a569dfd Jul 08 02:43:33 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:34 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-281b640d-ca12-4e66-898c-a829af223fae" returned: 0 in 0.748s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.471s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1819756584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35eb3dca-547a-4124-98b1-17ef3afc77a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82f64bb795348098aea628c0a691b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:33Z,use_quota=True,user_id='29844cb3afd4438e8f0e7d42103cb86b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Creating volume 35eb3dca-547a-4124-98b1-17ef3afc77a4 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:43:34 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-35eb3dca-547a-4124-98b1-17ef3afc77a4 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d78efdf-e33a-40af-ac2d-750a25c1a9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-281b640d-ca12-4e66-898c-a829af223fae', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:34 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-35eb3dca-547a-4124-98b1-17ef3afc77a4 1073741824 Jul 08 02:43:34 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d45908-9d53-4510-8e62-2c79af6c3233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:34 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Volume volume-281b640d-ca12-4e66-898c-a829af223fae (281b640d-ca12-4e66-898c-a829af223fae): created successfully Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d45908-9d53-4510-8e62-2c79af6c3233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Flow 'volume_create_manager' (f94b1653-cade-4e45-9c6b-ccff50edf423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:34 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a163b0d9-ca7f-4f19-8288-9f9f53775d82 tempest-VolumeTypesAccessTest-780345108 None] Created volume successfully. Jul 08 02:43:34 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3dc7568b-fc96-400b-b90e-11ad4a569dfd" returned: 0 in 0.756s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Lock "cinder-quobyte-3dc7568b-fc96-400b-b90e-11ad4a569dfd" released by "delete_volume" :: held 1.687s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Created reservations ['7e55eca7-51f6-4060-a701-26e4badc0ce0', '765cceb3-0226-498f-86e1-191bb1dc6aa0', '10128104-1250-47ee-a42b-43f699b03464', 'a5069a3f-9fe1-4a74-a0c4-f84ebcc343dc'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:34 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:43:34 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:35 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-35eb3dca-547a-4124-98b1-17ef3afc77a4 1073741824" returned: 0 in 0.939s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-35eb3dca-547a-4124-98b1-17ef3afc77a4 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:35 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-35eb3dca-547a-4124-98b1-17ef3afc77a4 Jul 08 02:43:35 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:35 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.781s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Acquiring lock "cinder-281b640d-ca12-4e66-898c-a829af223fae-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:35 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Deleted volume successfully. Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Lock "cinder-281b640d-ca12-4e66-898c-a829af223fae-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a1c1b53e-23ff-44bd-b07c-3ba891b04fa8 tempest-ProjectReaderTests-1604143971 None] Lock "cinder-3dc7568b-fc96-400b-b90e-11ad4a569dfd-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Acquiring lock "cinder-quobyte-281b640d-ca12-4e66-898c-a829af223fae" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Lock "cinder-quobyte-281b640d-ca12-4e66-898c-a829af223fae" acquired by "delete_volume" :: waited 0.014s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[76561bfe-2079-4a94-a952-65198e49352e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-281b640d-ca12-4e66-898c-a829af223fae {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Flow 'volume_create_manager' (a270d221-e25b-459f-806d-982b83840978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0263e23-37dc-44ef-aea2-5e6b94f6f960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0263e23-37dc-44ef-aea2-5e6b94f6f960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1739848923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f53980-0ca7-4668-9e4a-f64415d60720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378efc8dc17b4b8bb27116d71597f2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:36Z,use_quota=True,user_id='6f03a887bc584f13bc660bf6be006da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4012a6-daca-4ea3-8370-7ab29b9277e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4012a6-daca-4ea3-8370-7ab29b9277e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daff22cb-b876-40a7-bb25-8f9b05d388e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daff22cb-b876-40a7-bb25-8f9b05d388e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09f53980-0ca7-4668-9e4a-f64415d60720', 'volume_name': 'volume-09f53980-0ca7-4668-9e4a-f64415d60720', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff02b91e-4dd3-4ca3-8aec-aefadc2b9499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff02b91e-4dd3-4ca3-8aec-aefadc2b9499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:35 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-281b640d-ca12-4e66-898c-a829af223fae Jul 08 02:43:35 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bdef91-840b-44c3-bad2-36c8f2d5f2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:35 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Volume 09f53980-0ca7-4668-9e4a-f64415d60720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09f53980-0ca7-4668-9e4a-f64415d60720', 'volume_size': 1} Jul 08 02:43:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:36 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-35eb3dca-547a-4124-98b1-17ef3afc77a4" returned: 0 in 0.894s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.378s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1739848923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f53980-0ca7-4668-9e4a-f64415d60720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378efc8dc17b4b8bb27116d71597f2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:36Z,use_quota=True,user_id='6f03a887bc584f13bc660bf6be006da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Creating volume 09f53980-0ca7-4668-9e4a-f64415d60720 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:43:36 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-09f53980-0ca7-4668-9e4a-f64415d60720 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60baccb8-853d-46ee-892f-9ff1c6bc4b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35eb3dca-547a-4124-98b1-17ef3afc77a4', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c49084-b436-4645-9009-ec800f97e763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:36 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-09f53980-0ca7-4668-9e4a-f64415d60720 1073741824 Jul 08 02:43:36 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:36 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Volume volume-35eb3dca-547a-4124-98b1-17ef3afc77a4 (35eb3dca-547a-4124-98b1-17ef3afc77a4): created successfully Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c49084-b436-4645-9009-ec800f97e763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Flow 'volume_create_manager' (9c09d500-acbd-482f-aef0-dd1f0621f201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:36 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-4f73a2f0-faab-4da0-862c-171867097d7f tempest-VolumesTransfersTest-472735369 None] Created volume successfully. Jul 08 02:43:36 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-281b640d-ca12-4e66-898c-a829af223fae" returned: 0 in 0.900s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-281b640d-ca12-4e66-898c-a829af223fae {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:36 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-281b640d-ca12-4e66-898c-a829af223fae Jul 08 02:43:36 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:37 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-09f53980-0ca7-4668-9e4a-f64415d60720 1073741824" returned: 0 in 1.105s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-09f53980-0ca7-4668-9e4a-f64415d60720 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:37 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-09f53980-0ca7-4668-9e4a-f64415d60720 Jul 08 02:43:37 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:37 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-281b640d-ca12-4e66-898c-a829af223fae" returned: 0 in 0.839s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Lock "cinder-quobyte-281b640d-ca12-4e66-898c-a829af223fae" released by "delete_volume" :: held 1.840s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:37 devstack cinder-volume[87238]: WARNING cinder.quota [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1327822038 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1327822038, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:43:37 devstack cinder-volume[87238]: WARNING cinder.quota [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1327822038 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1327822038, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:43:37 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Created reservations ['f41b14c1-dd57-4ca9-8b05-f6bbd222791f', 'f3a239f7-e84d-425b-ba09-a5216d13938e', '17406a6a-9492-405f-b4c2-06df63accd9c', '5cdb88ab-d2b3-461d-a5ad-68e696b11ef7'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:43:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:37 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:43:37 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:37 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-1c868c44-95ff-425d-91bb-f76a62cecc0d tempest-VolumesTransfersTest-817567756 None] Transfer volume completed successfully. Jul 08 02:43:38 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-09f53980-0ca7-4668-9e4a-f64415d60720" returned: 0 in 0.792s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:43:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bdef91-840b-44c3-bad2-36c8f2d5f2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09f53980-0ca7-4668-9e4a-f64415d60720', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5ef10a-50d9-49ed-9f10-b4fd2058eea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:38 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Volume volume-09f53980-0ca7-4668-9e4a-f64415d60720 (09f53980-0ca7-4668-9e4a-f64415d60720): created successfully Jul 08 02:43:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5ef10a-50d9-49ed-9f10-b4fd2058eea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Flow 'volume_create_manager' (a270d221-e25b-459f-806d-982b83840978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:38 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-6bb731d9-be87-4522-80e3-fbd9e8b19d24 tempest-ProjectReaderTests-1604143971 None] Created volume successfully. Jul 08 02:43:38 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.824s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:38 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:43:38 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Deleted volume successfully. Jul 08 02:43:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1e6ab007-bb83-4fbf-a94d-44e448bf7b0c tempest-VolumeTypesAccessTest-780345108 None] Lock "cinder-281b640d-ca12-4e66-898c-a829af223fae-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Acquiring lock "cinder-09f53980-0ca7-4668-9e4a-f64415d60720-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Lock "cinder-09f53980-0ca7-4668-9e4a-f64415d60720-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Acquiring lock "cinder-quobyte-09f53980-0ca7-4668-9e4a-f64415d60720" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Lock "cinder-quobyte-09f53980-0ca7-4668-9e4a-f64415d60720" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:39 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08fb997-26c1-4176-9694-6ebd67176369]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-09f53980-0ca7-4668-9e4a-f64415d60720 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:39 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-09f53980-0ca7-4668-9e4a-f64415d60720 Jul 08 02:43:39 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Acquiring lock "cinder-35eb3dca-547a-4124-98b1-17ef3afc77a4-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Lock "cinder-35eb3dca-547a-4124-98b1-17ef3afc77a4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Acquiring lock "cinder-quobyte-35eb3dca-547a-4124-98b1-17ef3afc77a4" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Lock "cinder-quobyte-35eb3dca-547a-4124-98b1-17ef3afc77a4" acquired by "delete_volume" :: waited 0.028s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:39 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb65c1d7-bee6-4f4b-902c-6d82345fbe7c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-35eb3dca-547a-4124-98b1-17ef3afc77a4 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:39 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-35eb3dca-547a-4124-98b1-17ef3afc77a4 Jul 08 02:43:39 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:40 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-09f53980-0ca7-4668-9e4a-f64415d60720" returned: 0 in 1.039s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-09f53980-0ca7-4668-9e4a-f64415d60720 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:40 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-09f53980-0ca7-4668-9e4a-f64415d60720 Jul 08 02:43:40 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:40 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-35eb3dca-547a-4124-98b1-17ef3afc77a4" returned: 0 in 0.964s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-35eb3dca-547a-4124-98b1-17ef3afc77a4 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:40 devstack sudo[95151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-35eb3dca-547a-4124-98b1-17ef3afc77a4 Jul 08 02:43:40 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:40 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-09f53980-0ca7-4668-9e4a-f64415d60720" returned: 0 in 0.855s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Lock "cinder-quobyte-09f53980-0ca7-4668-9e4a-f64415d60720" released by "delete_volume" :: held 1.959s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Created reservations ['5a938754-7521-47ba-8480-885be3979d44', '39e450ac-08f3-4a2a-bea9-64284e07efab', '122eaa13-9960-40b6-8bac-f4f29d329b66', '3e97354e-eace-4635-bfd4-d830078a6c6d'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:41 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:43:41 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:41 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-35eb3dca-547a-4124-98b1-17ef3afc77a4" returned: 0 in 1.012s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Lock "cinder-quobyte-35eb3dca-547a-4124-98b1-17ef3afc77a4" released by "delete_volume" :: held 2.042s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Created reservations ['37a7b377-2aa2-4b45-b705-6d16d5330569', '545cb029-5a6a-4c1e-8ba3-dc214cd69c3d', '612b1134-bcaa-4144-81ab-b0830d129249', '476744eb-6b39-4600-9914-b3161022f135'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:41 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:43:41 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:42 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.993s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:42 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:43:42 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Deleted volume successfully. Jul 08 02:43:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ba3952eb-ba8e-4177-bbe2-f7e400841850 tempest-ProjectReaderTests-1604143971 None] Lock "cinder-09f53980-0ca7-4668-9e4a-f64415d60720-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:42 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.958s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:42 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:43:42 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Deleted volume successfully. Jul 08 02:43:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e48d58a8-b05f-4161-91f9-4828e79d0b61 tempest-VolumesTransfersTest-2127969184 None] Lock "cinder-35eb3dca-547a-4124-98b1-17ef3afc77a4-delete_volume" released by "delete_volume" :: held 3.390s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Flow 'volume_create_manager' (0b2ce6ef-c024-48ab-ae5c-63955df16dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff88f1b2-15a8-49d1-b510-36c7b64fee0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff88f1b2-15a8-49d1-b510-36c7b64fee0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1685930225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82f64bb795348098aea628c0a691b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:43Z,use_quota=True,user_id='29844cb3afd4438e8f0e7d42103cb86b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc807cb-9c67-458e-a00d-cc25542d640b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc807cb-9c67-458e-a00d-cc25542d640b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd754fe9-14d7-4fec-b031-5f0cc9b41d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd754fe9-14d7-4fec-b031-5f0cc9b41d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f', 'volume_name': 'volume-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a776d5be-ad84-4dc9-a2c9-54e5e2968ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a776d5be-ad84-4dc9-a2c9-54e5e2968ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0003f982-4941-4f6a-a7f5-9437ee90ce29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:43 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Volume 6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f', 'volume_size': 1} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1685930225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82f64bb795348098aea628c0a691b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:43Z,use_quota=True,user_id='29844cb3afd4438e8f0e7d42103cb86b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Creating volume 6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:43:43 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:43:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:43 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f 1073741824 Jul 08 02:43:43 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:44 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f 1073741824" returned: 0 in 1.008s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:44 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f Jul 08 02:43:44 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:45 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f" returned: 0 in 0.746s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:43:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0003f982-4941-4f6a-a7f5-9437ee90ce29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddb6aa3-f6d8-4bb4-8810-6b1f8c4f2c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:45 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Volume volume-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f (6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f): created successfully Jul 08 02:43:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddb6aa3-f6d8-4bb4-8810-6b1f8c4f2c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Flow 'volume_create_manager' (0b2ce6ef-c024-48ab-ae5c-63955df16dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:45 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-27b2fcf7-220c-4a80-a25b-0371d696f8d5 tempest-VolumesTransfersTest-472735369 None] Created volume successfully. Jul 08 02:43:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Acquiring lock "cinder-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Lock "cinder-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Acquiring lock "cinder-quobyte-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:43:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Lock "cinder-quobyte-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f" acquired by "delete_volume" :: waited 0.027s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:43:47 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb984ed4-ec3b-43b9-95f0-187d610b0aa9]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:43:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:47 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f Jul 08 02:43:47 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:43:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:47 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:43:47 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:48 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f" returned: 0 in 1.087s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:48 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f Jul 08 02:43:48 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:48 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.182s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:43:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:43:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:43:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:43:48 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f" returned: 0 in 0.811s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Lock "cinder-quobyte-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f" released by "delete_volume" :: held 1.950s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:49 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=132,cinder:UPDATE=148,cinder:INSERT=31,cinder:DELETE=8 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:43:49 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=110,cinder:INSERT=51,cinder:UPDATE=167,cinder:DELETE=19 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:43:49 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Created reservations ['b0646680-6746-4e75-8577-37eb92e92e48', '99dd8dbb-1f88-41c0-bbbf-b50e2cc869f7', '025f3769-374f-46ad-810b-1698c651b7b4', 'e05a0bb8-4ea3-4aed-a63d-3841729d01ef'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:43:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:49 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:43:49 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:50 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.963s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:50 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:43:50 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Deleted volume successfully. Jul 08 02:43:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4f6782bf-8903-48ee-a961-1eb09a6d2917 tempest-VolumesTransfersTest-2127969184 None] Lock "cinder-6769f8d2-4e4f-4ab0-ac27-9dea7e7e7c5f-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Flow 'volume_create_manager' (6c413641-21e7-4cb4-85a3-d7b193e8a7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0470ffd-35c0-4886-907e-d03636e95ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0470ffd-35c0-4886-907e-d03636e95ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-829537157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e027c530-c4d1-4f3f-b467-a0d2eab8a4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51089a11c8e4039ae61eb2258f05bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:57Z,use_quota=True,user_id='822d73c62d0c496185435ae418f087e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b07a4af-e44b-432d-871f-f8ad612cfc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b07a4af-e44b-432d-871f-f8ad612cfc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fcb300f-5628-4e37-a295-5f90a57607a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fcb300f-5628-4e37-a295-5f90a57607a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e027c530-c4d1-4f3f-b467-a0d2eab8a4e5', 'volume_name': 'volume-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72dc690-4b26-4894-8f79-a0934000c834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72dc690-4b26-4894-8f79-a0934000c834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057abd98-f8a1-417e-be8f-4e44d72c0107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:57 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Volume e027c530-c4d1-4f3f-b467-a0d2eab8a4e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5', 'volume_size': 1} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-829537157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e027c530-c4d1-4f3f-b467-a0d2eab8a4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51089a11c8e4039ae61eb2258f05bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:43:57Z,use_quota=True,user_id='822d73c62d0c496185435ae418f087e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Creating volume e027c530-c4d1-4f3f-b467-a0d2eab8a4e5 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:43:57 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:43:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:57 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5 1073741824 Jul 08 02:43:57 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:58 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5 1073741824" returned: 0 in 1.011s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:43:58 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5 Jul 08 02:43:58 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:43:59 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Jul 08 02:43:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5" returned: 0 in 0.843s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:43:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:43:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:43:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057abd98-f8a1-417e-be8f-4e44d72c0107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30a0959-7cb8-4a1a-85a4-ce34fac47d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:43:59 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Volume volume-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5 (e027c530-c4d1-4f3f-b467-a0d2eab8a4e5): created successfully Jul 08 02:43:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30a0959-7cb8-4a1a-85a4-ce34fac47d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:43:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Flow 'volume_create_manager' (6c413641-21e7-4cb4-85a3-d7b193e8a7aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:43:59 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-1f01515a-66e5-4b2e-b2f4-07e864b2ffc2 tempest-VolumesListAdminTestJSON-1586556051 None] Created volume successfully. Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Flow 'volume_create_manager' (12f1fd9b-c65f-4356-ae59-1b2e205596b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4e7546-793e-4ff3-a0e5-e96e50bf41d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4e7546-793e-4ff3-a0e5-e96e50bf41d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-579261589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51089a11c8e4039ae61eb2258f05bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:44:01Z,use_quota=True,user_id='822d73c62d0c496185435ae418f087e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cba9ca0-153e-4b91-98c3-48a8c98bf72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cba9ca0-153e-4b91-98c3-48a8c98bf72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e2facb-b1ac-4e97-a120-d6ff4b1c720e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e2facb-b1ac-4e97-a120-d6ff4b1c720e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef', 'volume_name': 'volume-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a9e84f1-fdb4-449a-945f-f378761a0814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a9e84f1-fdb4-449a-945f-f378761a0814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96465df-44f6-482b-bb5a-806a3ba6435c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:01 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Volume cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef', 'volume_size': 1} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-579261589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51089a11c8e4039ae61eb2258f05bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:44:01Z,use_quota=True,user_id='822d73c62d0c496185435ae418f087e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Creating volume cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:44:01 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:44:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:01 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef 1073741824 Jul 08 02:44:01 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:02 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef 1073741824" returned: 0 in 1.142s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:02 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef Jul 08 02:44:02 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:03 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef" returned: 0 in 0.756s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:44:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96465df-44f6-482b-bb5a-806a3ba6435c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ec99c8-7f4b-47ce-b112-e1f973a02e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:03 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Volume volume-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef (cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef): created successfully Jul 08 02:44:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ec99c8-7f4b-47ce-b112-e1f973a02e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Flow 'volume_create_manager' (12f1fd9b-c65f-4356-ae59-1b2e205596b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:44:03 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-cbea6aca-c4e4-4289-8b0a-d7e9954d6b4a tempest-VolumesListAdminTestJSON-1586556051 None] Created volume successfully. Jul 08 02:44:04 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Flow 'volume_create_manager' (0a409e21-7e9b-4c4b-9cdf-1c871cca3acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c528f96-7b76-443a-a7e4-f7df22d9372b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c528f96-7b76-443a-a7e4-f7df22d9372b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1881706689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6e0c48-7ce6-44b2-b5fd-705e75f9e388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51089a11c8e4039ae61eb2258f05bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:44:05Z,use_quota=True,user_id='822d73c62d0c496185435ae418f087e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9b91d2-780d-44d9-a06d-5dc87404706b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9b91d2-780d-44d9-a06d-5dc87404706b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863efe74-873b-4e40-9886-26d14dc4ad0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863efe74-873b-4e40-9886-26d14dc4ad0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e6e0c48-7ce6-44b2-b5fd-705e75f9e388', 'volume_name': 'volume-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab413b1-c549-496b-8eca-718df740fb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab413b1-c549-496b-8eca-718df740fb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca64f719-e4de-495e-abc5-ff19c1443063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:05 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Volume 8e6e0c48-7ce6-44b2-b5fd-705e75f9e388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388', 'volume_size': 1} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1881706689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6e0c48-7ce6-44b2-b5fd-705e75f9e388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51089a11c8e4039ae61eb2258f05bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:44:05Z,use_quota=True,user_id='822d73c62d0c496185435ae418f087e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Creating volume 8e6e0c48-7ce6-44b2-b5fd-705e75f9e388 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:44:05 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:44:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:05 devstack sudo[95226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388 1073741824 Jul 08 02:44:05 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:06 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388 1073741824" returned: 0 in 1.039s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:06 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388 Jul 08 02:44:06 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:06 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388" returned: 0 in 0.766s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:44:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca64f719-e4de-495e-abc5-ff19c1443063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a40ac2-542d-4d4e-9d96-33aacab74cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:07 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Volume volume-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388 (8e6e0c48-7ce6-44b2-b5fd-705e75f9e388): created successfully Jul 08 02:44:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a40ac2-542d-4d4e-9d96-33aacab74cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Flow 'volume_create_manager' (0a409e21-7e9b-4c4b-9cdf-1c871cca3acc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:44:07 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c70fdabe-64a8-45de-8c6f-75243b56ba34 tempest-VolumesListAdminTestJSON-1586556051 None] Created volume successfully. Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Flow 'volume_create_manager' (7a107016-a6d1-488d-8d34-5914fcd6cdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0400ef8-5fdf-4a1e-b1f0-d1ff53dc2a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0400ef8-5fdf-4a1e-b1f0-d1ff53dc2a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e2b8c9e-d07e-4076-a18c-00c7dfa73a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4211b2488048ed839417ed9c8763af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:44:09Z,use_quota=True,user_id='f560fbb761d444cea1a5619c63599821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afc142d-2afa-4e61-8689-d4fea24fcc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afc142d-2afa-4e61-8689-d4fea24fcc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa404c36-712f-4950-b148-30f4efc7b01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa404c36-712f-4950-b148-30f4efc7b01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e2b8c9e-d07e-4076-a18c-00c7dfa73a76', 'volume_name': 'volume-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ae43f7-9bf7-4801-beec-32422f15c2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ae43f7-9bf7-4801-beec-32422f15c2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c39e0b-f970-46ae-80ab-e63dfda67310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:09 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Volume 7e2b8c9e-d07e-4076-a18c-00c7dfa73a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76', 'volume_size': 1} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e2b8c9e-d07e-4076-a18c-00c7dfa73a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4211b2488048ed839417ed9c8763af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:44:09Z,use_quota=True,user_id='f560fbb761d444cea1a5619c63599821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Creating volume 7e2b8c9e-d07e-4076-a18c-00c7dfa73a76 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:44:09 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:09 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76 1073741824 Jul 08 02:44:09 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Flow 'volume_create_manager' (4da8717b-81bf-4c77-98b4-992cf87db301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d710258e-767d-4243-bdcc-ff729795e0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d710258e-767d-4243-bdcc-ff729795e0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-64654969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff3baf4-be62-413b-bf93-87c28cc63e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6972ea845f3e462c98dbcfa7487abb76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:44:09Z,use_quota=True,user_id='92ee53be742f491a808b83e05979c0d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5b117e-96a6-49b3-a497-3e1cd3de0a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5b117e-96a6-49b3-a497-3e1cd3de0a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a9c3cf-cd7c-4057-819a-3b6a65b25d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a9c3cf-cd7c-4057-819a-3b6a65b25d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ff3baf4-be62-413b-bf93-87c28cc63e8c', 'volume_name': 'volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bddb78e-687e-453b-9e9c-5ae37379f693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bddb78e-687e-453b-9e9c-5ae37379f693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f23c15f-545c-4001-8dff-84ed84c90e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:09 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Volume 8ff3baf4-be62-413b-bf93-87c28cc63e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c', 'volume_size': 1} Jul 08 02:44:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:10 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76 1073741824" returned: 0 in 1.155s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:10 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76 Jul 08 02:44:10 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:11 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76" returned: 0 in 0.724s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.560s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-64654969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff3baf4-be62-413b-bf93-87c28cc63e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6972ea845f3e462c98dbcfa7487abb76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:44:09Z,use_quota=True,user_id='92ee53be742f491a808b83e05979c0d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Creating volume 8ff3baf4-be62-413b-bf93-87c28cc63e8c {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:44:11 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:11 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c 1073741824 Jul 08 02:44:11 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c39e0b-f970-46ae-80ab-e63dfda67310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98666d41-d9c0-4030-909c-a77b8bbbd36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:11 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Volume volume-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76 (7e2b8c9e-d07e-4076-a18c-00c7dfa73a76): created successfully Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98666d41-d9c0-4030-909c-a77b8bbbd36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Flow 'volume_create_manager' (7a107016-a6d1-488d-8d34-5914fcd6cdf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:44:11 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-9d567dde-3195-43df-9101-31e0227b849d tempest-VolumesListAdminTestJSON-1603413670 None] Created volume successfully. Jul 08 02:44:12 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c 1073741824" returned: 0 in 1.230s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Acquiring lock "cinder-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:12 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c Jul 08 02:44:12 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Lock "cinder-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Acquiring lock "cinder-quobyte-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Lock "cinder-quobyte-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76" acquired by "delete_volume" :: waited 0.042s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Acquiring lock "cinder-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:12 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8151d55-8356-4af5-8b46-40d7099218a8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Lock "cinder-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Acquiring lock "cinder-quobyte-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Lock "cinder-quobyte-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388" acquired by "delete_volume" :: waited 0.027s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:12 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc228f0-fc9b-4122-8b18-c1a1d30dff03]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:13 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76 Jul 08 02:44:13 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:13 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388 Jul 08 02:44:13 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:13 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c" returned: 0 in 1.136s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] <== create_volume: return (2463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:44:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.469s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f23c15f-545c-4001-8dff-84ed84c90e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5912fbd3-1703-4675-a033-8053344a25d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:13 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Volume volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c (8ff3baf4-be62-413b-bf93-87c28cc63e8c): created successfully Jul 08 02:44:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5912fbd3-1703-4675-a033-8053344a25d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Flow 'volume_create_manager' (4da8717b-81bf-4c77-98b4-992cf87db301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:44:13 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c337da31-4589-4dff-bc08-ffcc57837ba1 tempest-VolumesActionsTest-46122221 None] Created volume successfully. Jul 08 02:44:13 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388" returned: 0 in 0.915s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:13 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76" returned: 0 in 1.166s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:13 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388 Jul 08 02:44:13 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:13 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76 Jul 08 02:44:13 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:14 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:14 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388" returned: 0 in 0.753s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76" returned: 0 in 0.728s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Lock "cinder-quobyte-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388" released by "delete_volume" :: held 1.742s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Lock "cinder-quobyte-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76" released by "delete_volume" :: held 1.987s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Created reservations ['9704d4d2-ed76-4a10-81fd-7c134827aba5', '67c235bf-c314-4888-b2c5-b877f91b5a9a', 'fe7d83bd-f0c2-4426-ad72-480c3280e47c', '73801f86-648b-47f1-b58b-ba75b324e095'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Created reservations ['40f40839-a461-4e73-8941-1812f535c4d4', '043b9e00-ecf6-4446-9087-58d131320b2a', '274b077d-b633-40bb-b37f-6030632e2058', '20d87287-faf7-4ad4-8a9e-bbd97c3c9baf'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:14 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:44:14 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:15 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:44:15 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Acquiring lock "cinder-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "cinder-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Acquiring lock "cinder-quobyte-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "cinder-quobyte-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef" acquired by "delete_volume" :: waited 0.033s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:15 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a3f660-5c33-47b0-bac4-c907ab1ef7dc]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:15 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef Jul 08 02:44:15 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:15 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.016s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:15 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:44:15 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Deleted volume successfully. Jul 08 02:44:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a9a6f2c4-cad2-497c-8303-b72436e4e0bc tempest-VolumesListAdminTestJSON-1586556051 None] Lock "cinder-8e6e0c48-7ce6-44b2-b5fd-705e75f9e388-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:16 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.225s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:16 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:44:16 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Deleted volume successfully. Jul 08 02:44:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7a1d9c1b-7729-404d-be44-bcc8ec3b78b3 tempest-VolumesListAdminTestJSON-1603413670 None] Lock "cinder-7e2b8c9e-d07e-4076-a18c-00c7dfa73a76-delete_volume" released by "delete_volume" :: held 3.660s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:16 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef" returned: 0 in 1.161s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:16 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef Jul 08 02:44:16 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:17 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef" returned: 0 in 0.726s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "cinder-quobyte-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef" released by "delete_volume" :: held 1.971s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:17 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Created reservations ['38e096d6-d12a-492e-8ead-1167626b14e1', '23208728-e7aa-4cc5-807f-d2983dadf4a3', '3c53f1d7-d77d-4f15-99e5-149afee164dc', '7ed5a74e-fb93-4632-81bf-59af173bbe9b'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:44:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:44:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:44:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:17 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:44:17 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:18 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.213s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:18 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:44:18 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Deleted volume successfully. Jul 08 02:44:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-54da0fdb-c16d-47c7-9153-083348511135 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "cinder-cb76c9e5-10c3-4d1b-8012-7fab0e6d7fef-delete_volume" released by "delete_volume" :: held 3.602s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Acquiring lock "cinder-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "cinder-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Acquiring lock "cinder-quobyte-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "cinder-quobyte-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5" acquired by "delete_volume" :: waited 0.032s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:19 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8b510d-6a6f-4890-b50d-ca09a3f28a68]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:19 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5 Jul 08 02:44:19 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:20 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5" returned: 0 in 1.233s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:20 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5 Jul 08 02:44:20 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:21 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5" returned: 0 in 1.364s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "cinder-quobyte-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5" released by "delete_volume" :: held 2.679s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:21 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Created reservations ['19a9bb64-abbc-4979-af38-4550e82a5940', '1b9c91a2-7ff2-4fe7-a674-9e0570e010be', '6057f9e7-e3c6-42ee-a0f6-0e9998f5eae2', '9f8b5067-9ec0-47bc-986d-79ca909de340'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:44:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:44:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:44:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:22 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:44:22 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:23 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.220s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:23 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:44:23 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Deleted volume successfully. Jul 08 02:44:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-90032117-b11c-438f-9d2b-9bb8b0a25ea3 tempest-VolumesListAdminTestJSON-1586556051 None] Lock "cinder-e027c530-c4d1-4f3f-b467-a0d2eab8a4e5-delete_volume" released by "delete_volume" :: held 4.384s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Flow 'volume_create_manager' (fece3648-1825-4713-8bb1-328cff7ddaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5c502a-9439-44fe-bd0e-ccb8092ee6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5c502a-9439-44fe-bd0e-ccb8092ee6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-223635512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19680e3-c2e7-4a61-aed6-e24c89f44d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6f950a6ac4415ebacd8f2db6e1fc53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:44:28Z,use_quota=True,user_id='171627af75394e7eb8db0220885f65fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae22d83f-45f4-4fec-ad25-a24c0e72baaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae22d83f-45f4-4fec-ad25-a24c0e72baaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de4d053-d388-4b7c-b61f-b814c4b0e21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de4d053-d388-4b7c-b61f-b814c4b0e21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e19680e3-c2e7-4a61-aed6-e24c89f44d61', 'volume_name': 'volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812b88b3-ae4b-4c83-8859-937519811bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812b88b3-ae4b-4c83-8859-937519811bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56aea6dd-360e-4776-a82d-c43673ce4c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:27 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Volume e19680e3-c2e7-4a61-aed6-e24c89f44d61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61', 'volume_size': 1} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-223635512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19680e3-c2e7-4a61-aed6-e24c89f44d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6f950a6ac4415ebacd8f2db6e1fc53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:44:28Z,use_quota=True,user_id='171627af75394e7eb8db0220885f65fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Creating volume e19680e3-c2e7-4a61-aed6-e24c89f44d61 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:44:27 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:44:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:27 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 1073741824 Jul 08 02:44:27 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:29 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 1073741824" returned: 0 in 1.263s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:29 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 Jul 08 02:44:29 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:29 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61" returned: 0 in 0.874s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] <== create_volume: return (2187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:44:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56aea6dd-360e-4776-a82d-c43673ce4c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df072b70-cb63-4556-a221-b79bb43a9251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:30 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Volume volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 (e19680e3-c2e7-4a61-aed6-e24c89f44d61): created successfully Jul 08 02:44:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df072b70-cb63-4556-a221-b79bb43a9251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Flow 'volume_create_manager' (fece3648-1825-4713-8bb1-328cff7ddaa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:44:30 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-644f87fa-8698-4ef5-9c93-3e79326ea2c3 tempest-SnapshotDependencyTests-2073296316 None] Created volume successfully. Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Flow 'volume_create_manager' (d7560de6-fd9f-40ea-b67c-436920e684dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5528ed81-12ff-4ef5-885c-4b6083faf3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] Creating offline snapshot b048b6cc-55d7-4216-acab-43fd736801d8 of volume e19680e3-c2e7-4a61-aed6-e24c89f44d61 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5528ed81-12ff-4ef5-885c-4b6083faf3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2077118405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01695b25-256b-45ee-8657-56b086c409ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1283280ca9334b7cbc5e70ebf5ef1c71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:44:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:44:31Z,use_quota=True,user_id='842ff193ab48447d97759197d692d960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef1654b-23fa-4882-97ae-f838523b5742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef1654b-23fa-4882-97ae-f838523b5742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5be091f-fe2d-4b5f-a7ea-b7727cac0ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5be091f-fe2d-4b5f-a7ea-b7727cac0ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01695b25-256b-45ee-8657-56b086c409ca', 'volume_name': 'volume-01695b25-256b-45ee-8657-56b086c409ca', 'volume_size': 2}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cdadfd2-2b65-41dd-86e2-c8bf8f27f7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cdadfd2-2b65-41dd-86e2-c8bf8f27f7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0105e68e-7081-4ae1-8591-fb5d2828db04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:31 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Volume 01695b25-256b-45ee-8657-56b086c409ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01695b25-256b-45ee-8657-56b086c409ca', 'volume_size': 2} Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b58425-d4a2-4cf1-a834-c39871750b0e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:31 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 Jul 08 02:44:31 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:32 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61" returned: 0 in 0.913s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:32 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 1G Jul 08 02:44:32 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:32 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 1G" returned: 0 in 0.835s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:32 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 Jul 08 02:44:32 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:33 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8" returned: 0 in 0.775s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:33 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 is being set with open permissions: ugo+rw Jul 08 02:44:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:33 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 Jul 08 02:44:33 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:34 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8" returned: 0 in 0.632s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:34 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.info Jul 08 02:44:34 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:35 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.info" returned: 0 in 0.751s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:35 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.info is being set with open permissions: ugo+rw Jul 08 02:44:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:35 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.info Jul 08 02:44:35 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5c5c939f-b0ef-4ace-9d63-6ca8bcc72e73 tempest-VolumesActionsTest-46122221 None] Acquiring lock "cinder-8ff3baf4-be62-413b-bf93-87c28cc63e8c" by "attach_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5c5c939f-b0ef-4ace-9d63-6ca8bcc72e73 tempest-VolumesActionsTest-46122221 None] Lock "cinder-8ff3baf4-be62-413b-bf93-87c28cc63e8c" acquired by "attach_volume" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:35 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.info" returned: 0 in 0.770s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.844s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.757s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2077118405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01695b25-256b-45ee-8657-56b086c409ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1283280ca9334b7cbc5e70ebf5ef1c71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:44:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:44:31Z,use_quota=True,user_id='842ff193ab48447d97759197d692d960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:44:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Creating volume 01695b25-256b-45ee-8657-56b086c409ca {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:44:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:44:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:44:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:44:35 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:44:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca 2147483648 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:36 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca 2147483648 Jul 08 02:44:36 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:36 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5c5c939f-b0ef-4ace-9d63-6ca8bcc72e73 tempest-VolumesActionsTest-46122221 None] Attaching volume 8ff3baf4-be62-413b-bf93-87c28cc63e8c to instance 65852553-5a4a-4680-bfa1-5826ac2e0efe at mountpoint /dev/vdb on host None. Jul 08 02:44:36 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b62c4397-66cb-4a5b-a31f-6d6a1431df97 tempest-SnapshotDependencyTests-2073296316 None] Create snapshot completed successfully Jul 08 02:44:36 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5c5c939f-b0ef-4ace-9d63-6ca8bcc72e73 tempest-VolumesActionsTest-46122221 None] Attach volume completed successfully. Jul 08 02:44:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5c5c939f-b0ef-4ace-9d63-6ca8bcc72e73 tempest-VolumesActionsTest-46122221 None] Lock "cinder-8ff3baf4-be62-413b-bf93-87c28cc63e8c" released by "attach_volume" :: held 0.221s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0acb864a-a382-456a-933a-1b459d057c4e tempest-VolumesActionsTest-46122221 None] Acquiring lock "cinder-8ff3baf4-be62-413b-bf93-87c28cc63e8c-detach_volume" by "detach_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0acb864a-a382-456a-933a-1b459d057c4e tempest-VolumesActionsTest-46122221 None] Lock "cinder-8ff3baf4-be62-413b-bf93-87c28cc63e8c-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:36 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0acb864a-a382-456a-933a-1b459d057c4e tempest-VolumesActionsTest-46122221 None] Detaching volume 8ff3baf4-be62-413b-bf93-87c28cc63e8c from instance 65852553-5a4a-4680-bfa1-5826ac2e0efe. Jul 08 02:44:36 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0acb864a-a382-456a-933a-1b459d057c4e tempest-VolumesActionsTest-46122221 None] Detach volume completed successfully. Jul 08 02:44:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0acb864a-a382-456a-933a-1b459d057c4e tempest-VolumesActionsTest-46122221 None] Lock "cinder-8ff3baf4-be62-413b-bf93-87c28cc63e8c-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:37 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:44:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Flow 'volume_create_manager' (84b84352-10db-46ab-81a2-929e7b3971df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:44:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd63c61-1909-41a6-b5c0-c6a5608a197a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd63c61-1909-41a6-b5c0-c6a5608a197a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a31b84-e1a2-432c-a269-3bf37fee161c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6f950a6ac4415ebacd8f2db6e1fc53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b048b6cc-55d7-4216-acab-43fd736801d8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:44:37Z,use_quota=True,user_id='171627af75394e7eb8db0220885f65fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4b7632-334a-4110-b170-ffc176dc0c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4b7632-334a-4110-b170-ffc176dc0c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5066209-3831-4659-a233-4376b059914a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5066209-3831-4659-a233-4376b059914a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '04a31b84-e1a2-432c-a269-3bf37fee161c', 'volume_name': 'volume-04a31b84-e1a2-432c-a269-3bf37fee161c', 'volume_size': 1, 'snapshot_id': 'b048b6cc-55d7-4216-acab-43fd736801d8'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ece25af-51d0-4add-8c8d-2990ac173a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ece25af-51d0-4add-8c8d-2990ac173a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:37 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de267dc-e399-43bd-b28a-2543cd463d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:37 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Volume 04a31b84-e1a2-432c-a269-3bf37fee161c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-04a31b84-e1a2-432c-a269-3bf37fee161c', 'volume_size': 1, 'snapshot_id': 'b048b6cc-55d7-4216-acab-43fd736801d8'} Jul 08 02:44:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca 2147483648" returned: 0 in 1.380s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:37 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca Jul 08 02:44:37 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:38 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca" returned: 0 in 0.736s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] <== create_volume: return (2171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.774s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "cinder-quobyte-b048b6cc-55d7-4216-acab-43fd736801d8-04a31b84-e1a2-432c-a269-3bf37fee161c" by "_create_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0105e68e-7081-4ae1-8591-fb5d2828db04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01695b25-256b-45ee-8657-56b086c409ca', 'volume_size': 2}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63207fd-580c-4b06-970c-1a795932cced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-quobyte-b048b6cc-55d7-4216-acab-43fd736801d8-04a31b84-e1a2-432c-a269-3bf37fee161c" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Creating volume 04a31b84-e1a2-432c-a269-3bf37fee161c from snapshot b048b6cc-55d7-4216-acab-43fd736801d8 {{(pid=87238) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "cinder-quobyte-04a31b84-e1a2-432c-a269-3bf37fee161c" by "_copy_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:38 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Volume volume-01695b25-256b-45ee-8657-56b086c409ca (01695b25-256b-45ee-8657-56b086c409ca): created successfully Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63207fd-580c-4b06-970c-1a795932cced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Flow 'volume_create_manager' (d7560de6-fd9f-40ea-b67c-436920e684dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-quobyte-04a31b84-e1a2-432c-a269-3bf37fee161c" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] snapshot: b048b6cc-55d7-4216-acab-43fd736801d8, volume: 04a31b84-e1a2-432c-a269-3bf37fee161c, {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:38 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e091c16a-630b-4620-a09b-fa47e88ab9c9 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Created volume successfully. Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[26da2808-4d79-47c8-9f17-487bd73b7dab]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:38 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 Jul 08 02:44:38 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:39 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8" returned: 0 in 0.934s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:44:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 02:44:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Creating direct copy from snapshot {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 02:44:39 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48411f4-9199-46b9-8bb8-9f496d974c6f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:39 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 Jul 08 02:44:39 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:40 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61" returned: 0 in 0.818s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:40 devstack cinder-volume[87238]: DEBUG cinder.utils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Path /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-04a31b84-e1a2-432c-a269-3bf37fee161c not found in is_blk_device check {{(pid=87238) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 02:44:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-04a31b84-e1a2-432c-a269-3bf37fee161c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:40 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-04a31b84-e1a2-432c-a269-3bf37fee161c Jul 08 02:44:40 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:44 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:44:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Flow 'volume_create_manager' (29120cb2-07e4-4dea-8943-30c2d76cda49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:44:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f1fe66-7e46-484c-82db-0b51ea51a4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f1fe66-7e46-484c-82db-0b51ea51a4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1865506097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f0358b-cfee-4111-8ff1-fc4bb4c0db78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f1f3c8272a14b28b87f9be697b8e9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:44:45Z,use_quota=True,user_id='577c9c242a7c466eb4f0a2928c7313a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca44519d-854c-4ac6-b466-41de3eee2067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca44519d-854c-4ac6-b466-41de3eee2067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1003ba5-ca40-439a-86a4-fc5dfab75231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1003ba5-ca40-439a-86a4-fc5dfab75231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f0358b-cfee-4111-8ff1-fc4bb4c0db78', 'volume_name': 'volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa6390b-7f7b-407d-9306-c2667704888a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa6390b-7f7b-407d-9306-c2667704888a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7a4bdc-c249-466f-9f18-b701cfb2a9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:45 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Volume 89f0358b-cfee-4111-8ff1-fc4bb4c0db78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78', 'volume_size': 1} Jul 08 02:44:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:45 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-04a31b84-e1a2-432c-a269-3bf37fee161c" returned: 0 in 5.478s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:45 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d3b9f8-8269-42e3-a6ae-22c95b7e9643]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:45 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 Jul 08 02:44:45 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:46 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61" returned: 0 in 0.943s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:46 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-04a31b84-e1a2-432c-a269-3bf37fee161c {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:44:46 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Converted 1024.00 MB image at 186.89 MB/s Jul 08 02:44:46 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-04a31b84-e1a2-432c-a269-3bf37fee161c is being set with open permissions: ugo+rw Jul 08 02:44:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-04a31b84-e1a2-432c-a269-3bf37fee161c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:46 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-04a31b84-e1a2-432c-a269-3bf37fee161c Jul 08 02:44:46 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:47 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-04a31b84-e1a2-432c-a269-3bf37fee161c" returned: 0 in 0.674s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-quobyte-04a31b84-e1a2-432c-a269-3bf37fee161c" released by "_copy_volume_from_snapshot" :: held 8.950s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-quobyte-b048b6cc-55d7-4216-acab-43fd736801d8-04a31b84-e1a2-432c-a269-3bf37fee161c" released by "_create_volume_from_snapshot" :: held 9.014s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.062s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.082s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Creating offline snapshot fc0bcf63-5d13-4526-90d2-351d10d151bf of volume 01695b25-256b-45ee-8657-56b086c409ca {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[355a11ad-6329-46df-b760-2412f361dcf6]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de267dc-e399-43bd-b28a-2543cd463d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a31b84-e1a2-432c-a269-3bf37fee161c', 'volume_size': 1, 'snapshot_id': 'b048b6cc-55d7-4216-acab-43fd736801d8'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567153c1-0cf1-48a5-a279-ef237cfa3faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:47 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:44:47 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:47 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Volume volume-04a31b84-e1a2-432c-a269-3bf37fee161c (04a31b84-e1a2-432c-a269-3bf37fee161c): created successfully Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567153c1-0cf1-48a5-a279-ef237cfa3faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Flow 'volume_create_manager' (84b84352-10db-46ab-81a2-929e7b3971df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:44:47 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-4da96ba0-5da3-42fe-b115-e47eb7e41805 tempest-SnapshotDependencyTests-2073296316 None] Created volume successfully. Jul 08 02:44:47 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca Jul 08 02:44:47 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:47 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.722s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:44:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:44:48 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca" returned: 0 in 0.818s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf 2G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:48 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf 2G Jul 08 02:44:48 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "cinder-b048b6cc-55d7-4216-acab-43fd736801d8-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-b048b6cc-55d7-4216-acab-43fd736801d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "cinder-quobyte-e19680e3-c2e7-4a61-aed6-e24c89f44d61" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-quobyte-e19680e3-c2e7-4a61-aed6-e24c89f44d61" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "cinder-quobyte-b048b6cc-55d7-4216-acab-43fd736801d8" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-quobyte-b048b6cc-55d7-4216-acab-43fd736801d8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Deleting offline snapshot b048b6cc-55d7-4216-acab-43fd736801d8 of volume e19680e3-c2e7-4a61-aed6-e24c89f44d61 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:44:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] snapshot_file for this snap is: volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:44:48 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[63285b28-292e-48b4-a8a5-6f6a4a4d539d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:48 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 Jul 08 02:44:48 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:48 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf 2G" returned: 0 in 0.860s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01695b25-256b-45ee-8657-56b086c409ca -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:48 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01695b25-256b-45ee-8657-56b086c409ca -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf Jul 08 02:44:48 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:49 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8" returned: 0 in 0.813s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:44:49 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[748c79df-7045-492d-94cb-2805c7a7a947]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:49 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 Jul 08 02:44:49 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:49 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01695b25-256b-45ee-8657-56b086c409ca -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf" returned: 0 in 0.742s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:49 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf is being set with open permissions: ugo+rw Jul 08 02:44:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:49 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf Jul 08 02:44:49 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:49 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61" returned: 0 in 0.797s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:49 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 Jul 08 02:44:49 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:50 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf" returned: 0 in 0.689s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:50 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=50,cinder:INSERT=18,cinder:UPDATE=68,cinder:DELETE=9 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:44:50 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=69,cinder:SELECT=56,cinder:DELETE=5,cinder:INSERT=12 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:44:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:50 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.info Jul 08 02:44:50 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:50 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8" returned: 0 in 0.758s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:50 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8 Jul 08 02:44:50 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:51 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.info" returned: 0 in 0.669s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:51 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.info is being set with open permissions: ugo+rw Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:51 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.info Jul 08 02:44:51 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:51 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61.b048b6cc-55d7-4216-acab-43fd736801d8" returned: 0 in 0.749s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-quobyte-b048b6cc-55d7-4216-acab-43fd736801d8" released by "_delete_snapshot" :: held 3.218s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-quobyte-e19680e3-c2e7-4a61-aed6-e24c89f44d61" released by "delete_snapshot" :: held 3.245s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Created reservations ['60be4786-22a1-48c3-a02e-110a432fdbc9', '91e154e1-6099-40c9-b2a7-ed2b6d247fba', 'f4ea3a04-f0c6-4662-910e-bc48a89e281d', '7b390db7-5084-4a47-9a82-6dadc5925d12'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:44:51 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Delete snapshot completed successfully. Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-57b76260-2dc5-4433-b85a-2573b3ab9b9f tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-b048b6cc-55d7-4216-acab-43fd736801d8-delete_snapshot" released by "delete_snapshot" :: held 3.393s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:51 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.info" returned: 0 in 0.675s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.572s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.744s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1865506097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f0358b-cfee-4111-8ff1-fc4bb4c0db78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f1f3c8272a14b28b87f9be697b8e9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:44:45Z,use_quota=True,user_id='577c9c242a7c466eb4f0a2928c7313a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Creating volume 89f0358b-cfee-4111-8ff1-fc4bb4c0db78 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:44:51 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:44:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:51 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78 1073741824 Jul 08 02:44:51 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:51 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-89aeac4f-a19f-47b4-98cd-9d266439c8a4 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Create snapshot completed successfully Jul 08 02:44:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "cinder-e19680e3-c2e7-4a61-aed6-e24c89f44d61-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-e19680e3-c2e7-4a61-aed6-e24c89f44d61-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "cinder-quobyte-e19680e3-c2e7-4a61-aed6-e24c89f44d61" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-quobyte-e19680e3-c2e7-4a61-aed6-e24c89f44d61" acquired by "delete_volume" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:52 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd84dc99-f58d-49e9-88b0-0e01f521c338]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:52 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 Jul 08 02:44:52 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:52 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78 1073741824" returned: 0 in 1.064s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:52 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78 Jul 08 02:44:52 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Acquiring lock "cinder-fc0bcf63-5d13-4526-90d2-351d10d151bf-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "cinder-fc0bcf63-5d13-4526-90d2-351d10d151bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Acquiring lock "cinder-quobyte-01695b25-256b-45ee-8657-56b086c409ca" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "cinder-quobyte-01695b25-256b-45ee-8657-56b086c409ca" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Acquiring lock "cinder-quobyte-fc0bcf63-5d13-4526-90d2-351d10d151bf" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "cinder-quobyte-fc0bcf63-5d13-4526-90d2-351d10d151bf" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Deleting offline snapshot fc0bcf63-5d13-4526-90d2-351d10d151bf of volume 01695b25-256b-45ee-8657-56b086c409ca {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:44:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] snapshot_file for this snap is: volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:44:53 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[257364a9-1c69-4e19-9772-c22b5eb6e4e5]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:53 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf Jul 08 02:44:53 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:53 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61" returned: 0 in 0.986s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:53 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61 Jul 08 02:44:53 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:53 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78" returned: 0 in 1.081s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7a4bdc-c249-466f-9f18-b701cfb2a9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1b4c8e-c950-4226-845b-22609148f6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:44:54 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Volume volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78 (89f0358b-cfee-4111-8ff1-fc4bb4c0db78): created successfully Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1b4c8e-c950-4226-845b-22609148f6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Flow 'volume_create_manager' (29120cb2-07e4-4dea-8943-30c2d76cda49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:44:54 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-20f63522-4f52-4a86-8fac-6f1882e67fe2 tempest-AttachVolumeTestJSON-1302012325 None] Created volume successfully. Jul 08 02:44:54 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf" returned: 0 in 1.169s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01695b25-256b-45ee-8657-56b086c409ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c146bd5-84f5-442f-9f1e-e40849626e11]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:54 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e19680e3-c2e7-4a61-aed6-e24c89f44d61" returned: 0 in 0.814s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-quobyte-e19680e3-c2e7-4a61-aed6-e24c89f44d61" released by "delete_volume" :: held 1.873s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Created reservations ['b9ea3173-23aa-4011-8139-4a951f74ba2e', 'e4ef149f-447f-47af-ae2d-557783970cd0', '61865cee-2878-447a-9c14-a9b57c2e5fe6', '9abeee27-ee0e-431a-92f5-9acde2bceaea'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:44:54 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca Jul 08 02:44:54 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:54 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:44:54 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "cinder-04a31b84-e1a2-432c-a269-3bf37fee161c-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-04a31b84-e1a2-432c-a269-3bf37fee161c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "cinder-quobyte-04a31b84-e1a2-432c-a269-3bf37fee161c" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-quobyte-04a31b84-e1a2-432c-a269-3bf37fee161c" acquired by "delete_volume" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d102e2-0339-4081-87a1-1fe1db32fe70]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-04a31b84-e1a2-432c-a269-3bf37fee161c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:55 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-04a31b84-e1a2-432c-a269-3bf37fee161c Jul 08 02:44:55 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:55 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:55 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca" returned: 0 in 0.896s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.749s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:55 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:44:55 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Deleted volume successfully. Jul 08 02:44:55 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf Jul 08 02:44:55 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b065ab8a-8384-4cf0-9565-177285d34c40 tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-e19680e3-c2e7-4a61-aed6-e24c89f44d61-delete_volume" released by "delete_volume" :: held 2.864s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:55 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-04a31b84-e1a2-432c-a269-3bf37fee161c" returned: 0 in 0.885s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-04a31b84-e1a2-432c-a269-3bf37fee161c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:55 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-04a31b84-e1a2-432c-a269-3bf37fee161c Jul 08 02:44:55 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:56 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf" returned: 0 in 0.800s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:56 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf Jul 08 02:44:56 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:56 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-04a31b84-e1a2-432c-a269-3bf37fee161c" returned: 0 in 0.684s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-quobyte-04a31b84-e1a2-432c-a269-3bf37fee161c" released by "delete_volume" :: held 1.623s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:56 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Created reservations ['7741fcd4-d975-417e-b338-8a57bc2908a0', '475458b4-1dd5-4fb7-9c7a-f3c6f64036ce', '0e3ca557-4ca1-417b-b7aa-6ca29f53ac11', '2621ba6a-f025-43e9-b740-f829c2178ef4'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:44:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:44:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:44:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:56 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:44:56 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:56 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca.fc0bcf63-5d13-4526-90d2-351d10d151bf" returned: 0 in 0.759s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "cinder-quobyte-fc0bcf63-5d13-4526-90d2-351d10d151bf" released by "_delete_snapshot" :: held 3.879s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "cinder-quobyte-01695b25-256b-45ee-8657-56b086c409ca" released by "delete_snapshot" :: held 3.945s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:57 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Created reservations ['9a7d08e9-d2d3-49f6-837b-9a241027cba3', '30340470-e161-463d-9a28-fcef6e5ef910', 'e1cf576a-57cf-4ad3-81a3-dee2a3a1012a', '5e2f0281-f3a0-4462-989c-a6f7ea260869'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:44:57 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Delete snapshot completed successfully. Jul 08 02:44:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e1ecf6c1-258b-42e9-b7b2-5f7924ce411a tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "cinder-fc0bcf63-5d13-4526-90d2-351d10d151bf-delete_snapshot" released by "delete_snapshot" :: held 4.287s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:57 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.941s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:57 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:44:57 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Deleted volume successfully. Jul 08 02:44:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff527781-69a1-458b-980f-e26f90a83a65 tempest-SnapshotDependencyTests-2073296316 None] Lock "cinder-04a31b84-e1a2-432c-a269-3bf37fee161c-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:44:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-acab3b1a-33a3-468d-992e-da4a56563230 req-d675c2ae-5e63-4612-b825-78856e80f85d tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:44:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-acab3b1a-33a3-468d-992e-da4a56563230 req-d675c2ae-5e63-4612-b825-78856e80f85d tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:44:57 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04126ae-f818-407e-85ff-b2c2924ea8ff]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-acab3b1a-33a3-468d-992e-da4a56563230 req-d675c2ae-5e63-4612-b825-78856e80f85d tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:57 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78 Jul 08 02:44:57 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Acquiring lock "cinder-01695b25-256b-45ee-8657-56b086c409ca-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "cinder-01695b25-256b-45ee-8657-56b086c409ca-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Acquiring lock "cinder-quobyte-01695b25-256b-45ee-8657-56b086c409ca" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:44:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "cinder-quobyte-01695b25-256b-45ee-8657-56b086c409ca" acquired by "delete_volume" :: waited 0.030s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:44:58 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[af09b606-4d38-4e18-97ef-a64469bce5ee]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:44:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:58 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca Jul 08 02:44:58 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:44:58 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-acab3b1a-33a3-468d-992e-da4a56563230 req-d675c2ae-5e63-4612-b825-78856e80f85d tempest-AttachVolumeTestJSON-1302012325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78" returned: 0 in 1.178s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-acab3b1a-33a3-468d-992e-da4a56563230 req-d675c2ae-5e63-4612-b825-78856e80f85d tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.208s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:44:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-acab3b1a-33a3-468d-992e-da4a56563230 req-d675c2ae-5e63-4612-b825-78856e80f85d tempest-AttachVolumeTestJSON-1302012325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21b55144-bb0e-46b2-93c1-2f8f54d33cc6', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:44:59 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-acab3b1a-33a3-468d-992e-da4a56563230 req-d675c2ae-5e63-4612-b825-78856e80f85d tempest-AttachVolumeTestJSON-1302012325 None] attachment_update completed successfully. Jul 08 02:44:59 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Jul 08 02:44:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca" returned: 0 in 1.146s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:44:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:44:59 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca Jul 08 02:44:59 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:00 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-01695b25-256b-45ee-8657-56b086c409ca" returned: 0 in 0.963s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:00 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "cinder-quobyte-01695b25-256b-45ee-8657-56b086c409ca" released by "delete_volume" :: held 2.179s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:45:00 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Created reservations ['87ca8feb-8a45-4383-9858-64fbc26fa4d7', 'ea28f8d2-2028-408c-8b90-d7eabc3e194a', '7ac42e0b-9774-4eed-8c1b-6b4370b91438', 'ed17607c-f137-4c71-80ec-93f6b800c7b9'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:45:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:45:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:45:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:45:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:45:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:45:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:00 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:45:00 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:01 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.957s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:01 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:45:01 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Deleted volume successfully. Jul 08 02:45:01 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-db13e6dd-2aed-4140-bbc2-473d55e97af7 tempest-VolumesSnapshotNegativeTestJSON-299425294 None] Lock "cinder-01695b25-256b-45ee-8657-56b086c409ca-delete_volume" released by "delete_volume" :: held 3.479s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:45:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c5dab808-3707-4d00-a60f-9c9f9d2509c9 tempest-VolumesActionsTest-46122221 None] Acquiring lock "cinder-8ff3baf4-be62-413b-bf93-87c28cc63e8c" by "attach_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:45:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c5dab808-3707-4d00-a60f-9c9f9d2509c9 tempest-VolumesActionsTest-46122221 None] Lock "cinder-8ff3baf4-be62-413b-bf93-87c28cc63e8c" acquired by "attach_volume" :: waited 0.027s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:45:02 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c5dab808-3707-4d00-a60f-9c9f9d2509c9 tempest-VolumesActionsTest-46122221 None] Attaching volume 8ff3baf4-be62-413b-bf93-87c28cc63e8c to instance 2a521d2b-de69-4d8e-b44a-5602b07feaa1 at mountpoint /dev/vdb on host None. Jul 08 02:45:02 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c5dab808-3707-4d00-a60f-9c9f9d2509c9 tempest-VolumesActionsTest-46122221 None] Attach volume completed successfully. Jul 08 02:45:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c5dab808-3707-4d00-a60f-9c9f9d2509c9 tempest-VolumesActionsTest-46122221 None] Lock "cinder-8ff3baf4-be62-413b-bf93-87c28cc63e8c" released by "attach_volume" :: held 0.139s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:45:03 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-776ed235-a734-4ddc-bec2-820a58d8e8b3 tempest-VolumesActionsTest-46122221 None] Acquiring lock "cinder-8ff3baf4-be62-413b-bf93-87c28cc63e8c-detach_volume" by "detach_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:45:03 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-776ed235-a734-4ddc-bec2-820a58d8e8b3 tempest-VolumesActionsTest-46122221 None] Lock "cinder-8ff3baf4-be62-413b-bf93-87c28cc63e8c-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:45:03 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-776ed235-a734-4ddc-bec2-820a58d8e8b3 tempest-VolumesActionsTest-46122221 None] Detaching volume 8ff3baf4-be62-413b-bf93-87c28cc63e8c from instance 2a521d2b-de69-4d8e-b44a-5602b07feaa1. Jul 08 02:45:03 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-776ed235-a734-4ddc-bec2-820a58d8e8b3 tempest-VolumesActionsTest-46122221 None] Detach volume completed successfully. Jul 08 02:45:03 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-776ed235-a734-4ddc-bec2-820a58d8e8b3 tempest-VolumesActionsTest-46122221 None] Lock "cinder-8ff3baf4-be62-413b-bf93-87c28cc63e8c-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:45:13 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=38,cinder:UPDATE=48,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:45:13 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=43,cinder:INSERT=13,cinder:UPDATE=38,cinder:DELETE=2 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:45:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-bbd8e1d4-a450-48b8-916d-bb22caea18a1 tempest-VolumesActionsTest-46122221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:45:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-bbd8e1d4-a450-48b8-916d-bb22caea18a1 tempest-VolumesActionsTest-46122221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:45:15 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[828e0cc4-4963-45b2-a083-37cd7496d09e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:45:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bbd8e1d4-a450-48b8-916d-bb22caea18a1 tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:15 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c Jul 08 02:45:15 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:16 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bbd8e1d4-a450-48b8-916d-bb22caea18a1 tempest-VolumesActionsTest-46122221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c" returned: 0 in 1.028s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:16 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caf9a2e-925e-46a2-a8d6-e97223d203e5]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:45:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bbd8e1d4-a450-48b8-916d-bb22caea18a1 tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:16 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c Jul 08 02:45:16 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:17 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bbd8e1d4-a450-48b8-916d-bb22caea18a1 tempest-VolumesActionsTest-46122221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c" returned: 0 in 1.028s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bbd8e1d4-a450-48b8-916d-bb22caea18a1 tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.5ed2046a-d82b-4a21-99c7-31808dcdccd03u3ex_9j.img {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:17 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.5ed2046a-d82b-4a21-99c7-31808dcdccd03u3ex_9j.img Jul 08 02:45:17 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:24 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bbd8e1d4-a450-48b8-916d-bb22caea18a1 tempest-VolumesActionsTest-46122221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.5ed2046a-d82b-4a21-99c7-31808dcdccd03u3ex_9j.img" returned: 0 in 7.211s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:24 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f15834-a94e-4609-8582-28efba2a5b24]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:45:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bbd8e1d4-a450-48b8-916d-bb22caea18a1 tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:24 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c Jul 08 02:45:24 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:25 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=1 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:45:25 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bbd8e1d4-a450-48b8-916d-bb22caea18a1 tempest-VolumesActionsTest-46122221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c" returned: 0 in 1.118s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:25 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-bbd8e1d4-a450-48b8-916d-bb22caea18a1 tempest-VolumesActionsTest-46122221 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c, size 1024.00 MB, duration 7.21 sec, destination /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.5ed2046a-d82b-4a21-99c7-31808dcdccd03u3ex_9j.img {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:45:25 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-bbd8e1d4-a450-48b8-916d-bb22caea18a1 tempest-VolumesActionsTest-46122221 None] Converted 1024.00 MB image at 141.97 MB/s Jul 08 02:45:25 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-bbd8e1d4-a450-48b8-916d-bb22caea18a1 tempest-VolumesActionsTest-46122221 None] 5ed2046a-d82b-4a21-99c7-31808dcdccd0 was raw, no need to convert to raw {{(pid=87238) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 08 02:45:35 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=2 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Flow 'volume_create_manager' (279b828f-2bdf-44f6-aedb-6c8152384e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2789402e-771c-4659-b5f8-4305266ddaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2789402e-771c-4659-b5f8-4305266ddaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1737801215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8975ddc-3425-4dbc-9282-3f61199f148a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095fbfe5ecb34a859d0b8099c3f17a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:45:37Z,use_quota=True,user_id='4b5b66f08c3a49d3911091bdb78be7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e5ea970-f086-4bd4-9ce8-96f0b9982809),volume_type_id=3e5ea970-f086-4bd4-9ce8-96f0b9982809)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e54b14-8b03-4a31-aea5-d79e27da1bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e54b14-8b03-4a31-aea5-d79e27da1bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb191893-fd0f-4908-9bf9-25f1fd930c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb191893-fd0f-4908-9bf9-25f1fd930c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8975ddc-3425-4dbc-9282-3f61199f148a', 'volume_name': 'volume-c8975ddc-3425-4dbc-9282-3f61199f148a', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c75cd2a-cd51-4cf4-9c92-d94f423d8c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c75cd2a-cd51-4cf4-9c92-d94f423d8c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56a3ec9-efca-4f08-99ff-ff55049bad6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:37 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Volume c8975ddc-3425-4dbc-9282-3f61199f148a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8975ddc-3425-4dbc-9282-3f61199f148a', 'volume_size': 1} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Flow 'volume_create_manager' (5350a769-0bb1-4c3c-8b7d-e607d37bb273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae25a792-c4d1-4aae-a193-14082abe6314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae25a792-c4d1-4aae-a193-14082abe6314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2083022316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4628bba-631b-42a7-a9a2-6399504a4703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095fbfe5ecb34a859d0b8099c3f17a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:45:38Z,use_quota=True,user_id='4b5b66f08c3a49d3911091bdb78be7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af2a0cbd-7adc-4634-b006-7252e6505af3),volume_type_id=af2a0cbd-7adc-4634-b006-7252e6505af3)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7582a61-43ec-4e7b-80c2-2e21d13fb562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7582a61-43ec-4e7b-80c2-2e21d13fb562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cff9002-f647-4717-b2ac-6425875dc1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cff9002-f647-4717-b2ac-6425875dc1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4628bba-631b-42a7-a9a2-6399504a4703', 'volume_name': 'volume-d4628bba-631b-42a7-a9a2-6399504a4703', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16352c5-1e6c-4928-a6ac-0ccb28fe0ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16352c5-1e6c-4928-a6ac-0ccb28fe0ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12b7480-6829-4acb-8507-bc8fa00b4650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:37 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Volume d4628bba-631b-42a7-a9a2-6399504a4703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4628bba-631b-42a7-a9a2-6399504a4703', 'volume_size': 1} Jul 08 02:45:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:45:39 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:45:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Flow 'volume_create_manager' (72762036-8414-4be7-9fa0-d8786141bf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:45:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84cba724-2b85-40fe-8cbe-4b901de975e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84cba724-2b85-40fe-8cbe-4b901de975e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-94386116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3f49df-60f7-4187-8425-0f1410f51698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095fbfe5ecb34a859d0b8099c3f17a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:45:39Z,use_quota=True,user_id='4b5b66f08c3a49d3911091bdb78be7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff02c728-877c-40a9-88e6-b78734800218),volume_type_id=ff02c728-877c-40a9-88e6-b78734800218)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:45:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1b55b7-b5dc-44a8-bd0f-0ade2d7a9e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1b55b7-b5dc-44a8-bd0f-0ade2d7a9e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:45:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f6610f-9106-413e-a340-4bf55d87e431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:39 devstack cinder-volume[87238]: DEBUG cinder.image.glance [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Creating Keystone auth plugin from conf {{(pid=87238) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 02:45:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f6610f-9106-413e-a340-4bf55d87e431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ff3f49df-60f7-4187-8425-0f1410f51698', 'volume_name': 'volume-ff3f49df-60f7-4187-8425-0f1410f51698', 'volume_size': 1, 'image_id': 'a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--390454588', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '095fbfe5ecb34a859d0b8099c3f17a0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df', 'created_at': datetime.datetime(2026, 7, 8, 0, 45, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 45, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df/file', 'properties': {}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:45:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aadcd60-6503-49a2-9c99-c2f36cc28f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aadcd60-6503-49a2-9c99-c2f36cc28f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:45:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dea50a1-f172-442a-b1b6-87de3f06c105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:39 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Volume ff3f49df-60f7-4187-8425-0f1410f51698: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ff3f49df-60f7-4187-8425-0f1410f51698', 'volume_size': 1, 'image_id': 'a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--390454588', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '095fbfe5ecb34a859d0b8099c3f17a0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df', 'created_at': datetime.datetime(2026, 7, 8, 0, 45, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 45, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df/file', 'properties': {}}, 'image_service': } Jul 08 02:45:39 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Trying to clone ff3f49df-60f7-4187-8425-0f1410f51698 from image a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df', 'metadata': {}}]). {{(pid=87238) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 02:45:43 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_dtny3k40devstack@QuobyteHD, size 20.69 MB, duration 4.23 sec {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 02:45:43 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Image download 20.69 MB at 4.88 MB/s Jul 08 02:45:43 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8fcee4-c455-418a-ae81-1ff046828764]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:45:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_dtny3k40devstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:43 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_dtny3k40devstack@QuobyteHD Jul 08 02:45:43 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:44 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_dtny3k40devstack@QuobyteHD" returned: 0 in 0.804s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:44 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Temporary image a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df is fetched for user 4b5b66f08c3a49d3911091bdb78be7f6. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 02:45:44 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd960b2-7a55-4647-81d2-07e9e5b416f1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:45:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_dtny3k40devstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:44 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_dtny3k40devstack@QuobyteHD Jul 08 02:45:44 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:45 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_dtny3k40devstack@QuobyteHD" returned: 0 in 0.849s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:45:46 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-f04c5dfa-67cd-4044-8ef5-49d66b552304 req-d8e86eb9-3659-4582-a377-a66b439e0485 tempest-AttachVolumeTestJSON-1302012325 None] Terminate volume connection completed successfully. Jul 08 02:45:46 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-f04c5dfa-67cd-4044-8ef5-49d66b552304 req-d8e86eb9-3659-4582-a377-a66b439e0485 tempest-AttachVolumeTestJSON-1302012325 None] Deleting attachment 21b55144-bb0e-46b2-93c1-2f8f54d33cc6. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:45:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:45:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:45:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:45:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:45:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:45:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:45:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:47 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:45:47 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:47 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.697s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:47 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:45:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:45:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:45:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:45:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-bbd8e1d4-a450-48b8-916d-bb22caea18a1 tempest-VolumesActionsTest-46122221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.323s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:45:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-bbd8e1d4-a450-48b8-916d-bb22caea18a1 tempest-VolumesActionsTest-46122221 None] Uploaded volume to glance image-id: 5ed2046a-d82b-4a21-99c7-31808dcdccd0. {{(pid=87238) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 02:45:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.877s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:45:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1737801215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8975ddc-3425-4dbc-9282-3f61199f148a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095fbfe5ecb34a859d0b8099c3f17a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:45:37Z,use_quota=True,user_id='4b5b66f08c3a49d3911091bdb78be7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e5ea970-f086-4bd4-9ce8-96f0b9982809),volume_type_id=3e5ea970-f086-4bd4-9ce8-96f0b9982809)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:45:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Creating volume c8975ddc-3425-4dbc-9282-3f61199f148a {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:45:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:45:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:45:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:45:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:45:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:45:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:45:48 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:45:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8975ddc-3425-4dbc-9282-3f61199f148a 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:48 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-bbd8e1d4-a450-48b8-916d-bb22caea18a1 tempest-VolumesActionsTest-46122221 None] Copy volume to image completed successfully. Jul 08 02:45:48 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8975ddc-3425-4dbc-9282-3f61199f148a 1073741824 Jul 08 02:45:48 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:49 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8975ddc-3425-4dbc-9282-3f61199f148a 1073741824" returned: 0 in 0.867s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8975ddc-3425-4dbc-9282-3f61199f148a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:49 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8975ddc-3425-4dbc-9282-3f61199f148a Jul 08 02:45:49 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:50 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8975ddc-3425-4dbc-9282-3f61199f148a" returned: 0 in 0.717s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.222s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2083022316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4628bba-631b-42a7-a9a2-6399504a4703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095fbfe5ecb34a859d0b8099c3f17a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:45:38Z,use_quota=True,user_id='4b5b66f08c3a49d3911091bdb78be7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af2a0cbd-7adc-4634-b006-7252e6505af3),volume_type_id=af2a0cbd-7adc-4634-b006-7252e6505af3)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Creating volume d4628bba-631b-42a7-a9a2-6399504a4703 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:45:50 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d4628bba-631b-42a7-a9a2-6399504a4703 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:50 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d4628bba-631b-42a7-a9a2-6399504a4703 1073741824 Jul 08 02:45:50 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56a3ec9-efca-4f08-99ff-ff55049bad6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8975ddc-3425-4dbc-9282-3f61199f148a', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3f3c28-9a05-49bd-80d8-9b32a60f7e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:45:50 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Volume volume-c8975ddc-3425-4dbc-9282-3f61199f148a (c8975ddc-3425-4dbc-9282-3f61199f148a): created successfully Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3f3c28-9a05-49bd-80d8-9b32a60f7e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:45:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Flow 'volume_create_manager' (279b828f-2bdf-44f6-aedb-6c8152384e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:45:50 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-82ad0e84-2b59-4997-9c6b-904d4714a996 tempest-TestInstancesWithCinderVolumes-1446990626 None] Created volume successfully. Jul 08 02:45:51 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d4628bba-631b-42a7-a9a2-6399504a4703 1073741824" returned: 0 in 0.831s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d4628bba-631b-42a7-a9a2-6399504a4703 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:51 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d4628bba-631b-42a7-a9a2-6399504a4703 Jul 08 02:45:51 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:51 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d4628bba-631b-42a7-a9a2-6399504a4703" returned: 0 in 0.638s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.304s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-94386116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3f49df-60f7-4187-8425-0f1410f51698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095fbfe5ecb34a859d0b8099c3f17a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:45:39Z,use_quota=True,user_id='4b5b66f08c3a49d3911091bdb78be7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff02c728-877c-40a9-88e6-b78734800218),volume_type_id=ff02c728-877c-40a9-88e6-b78734800218)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Creating volume ff3f49df-60f7-4187-8425-0f1410f51698 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:45:51 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12b7480-6829-4acb-8507-bc8fa00b4650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4628bba-631b-42a7-a9a2-6399504a4703', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9df3db-f66d-40b4-a98d-9f3d8b61a22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:45:51 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 1073741824 Jul 08 02:45:51 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:51 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Volume volume-d4628bba-631b-42a7-a9a2-6399504a4703 (d4628bba-631b-42a7-a9a2-6399504a4703): created successfully Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9df3db-f66d-40b4-a98d-9f3d8b61a22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:45:51 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Flow 'volume_create_manager' (5350a769-0bb1-4c3c-8b7d-e607d37bb273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:45:51 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-28936bd0-d395-4f8f-af1a-e9152b7e4aae tempest-TestInstancesWithCinderVolumes-1446990626 None] Created volume successfully. Jul 08 02:45:52 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 1073741824" returned: 0 in 0.862s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:52 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 Jul 08 02:45:52 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:53 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698" returned: 0 in 0.637s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:45:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:45:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:45:53 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[031c75d2-c6b4-47ab-b4ee-1106b963814d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:45:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:53 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Attempting download of a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df ((None, [{'url': 'file:///opt/stack/data/glance/images/a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df', 'metadata': {}}])) to volume ff3f49df-60f7-4187-8425-0f1410f51698. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 02:45:53 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b54be76-74d5-425a-b74c-bcb43a4f0545]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:45:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_88u76qfo {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:53 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c Jul 08 02:45:53 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:53 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_88u76qfo Jul 08 02:45:53 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:54 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c" returned: 0 in 0.862s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:54 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c017af-ef09-401e-b217-952853cebb82]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:45:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:54 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_88u76qfo" returned: 0 in 0.810s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_88u76qfo {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:54 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c Jul 08 02:45:54 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:54 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_88u76qfo Jul 08 02:45:54 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:54 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:54 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_88u76qfo" returned: 1 in 0.758s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_88u76qfo' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:45:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c" returned: 0 in 0.792s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.641566f7-2ad8-4e18-88ea-3ec187fea369_1ghsmcw.img {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:54 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9eaf59-c4c4-4ed7-a2f3-76857c2ffa1f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:45:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_dtny3k40devstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:54 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.641566f7-2ad8-4e18-88ea-3ec187fea369_1ghsmcw.img Jul 08 02:45:54 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:55 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_dtny3k40devstack@QuobyteHD Jul 08 02:45:55 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:45:55 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Jul 08 02:45:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_dtny3k40devstack@QuobyteHD" returned: 0 in 0.839s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:45:55 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df was qcow2, converting to raw {{(pid=87238) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 02:45:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_dtny3k40devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:45:55 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_dtny3k40devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 Jul 08 02:45:55 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:00 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_dtny3k40devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698" returned: 0 in 5.050s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:00 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df_dtny3k40devstack@QuobyteHD, size 112.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:46:00 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Converted 112.00 MB image at 22.17 MB/s Jul 08 02:46:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:00 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 1G Jul 08 02:46:00 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:01 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.641566f7-2ad8-4e18-88ea-3ec187fea369_1ghsmcw.img" returned: 0 in 6.054s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:01 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7810b7db-64e9-4fa3-9185-70c07f512a05]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:01 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c Jul 08 02:46:01 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:01 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 1G" returned: 0 in 1.061s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:01 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d963f2-55c3-4fa0-a59c-dbe9ed222e2c]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:02 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 Jul 08 02:46:02 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:02 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c" returned: 0 in 1.235s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:02 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.641566f7-2ad8-4e18-88ea-3ec187fea369_1ghsmcw.img {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:46:02 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Converted 1024.00 MB image at 169.11 MB/s Jul 08 02:46:02 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] 641566f7-2ad8-4e18-88ea-3ec187fea369 was raw, converting to qcow2 {{(pid=87238) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 08 02:46:02 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b09848-3d21-4b3c-a122-959b5118d2f0]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.641566f7-2ad8-4e18-88ea-3ec187fea369_1ghsmcw.img {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:02 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.641566f7-2ad8-4e18-88ea-3ec187fea369_1ghsmcw.img Jul 08 02:46:02 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:02 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698" returned: 0 in 0.816s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:02 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 Jul 08 02:46:02 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:03 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.641566f7-2ad8-4e18-88ea-3ec187fea369_1ghsmcw.img" returned: 0 in 0.884s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.641566f7-2ad8-4e18-88ea-3ec187fea369_1ghsmcw.img {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:03 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.641566f7-2ad8-4e18-88ea-3ec187fea369_1ghsmcw.img Jul 08 02:46:03 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:03 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698" returned: 1 in 0.807s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:46:03 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Downloaded image a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df ((None, [{'url': 'file:///opt/stack/data/glance/images/a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df', 'metadata': {}}])) to volume ff3f49df-60f7-4187-8425-0f1410f51698 successfully. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 02:46:03 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Temporary image a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df for user 4b5b66f08c3a49d3911091bdb78be7f6 is deleted. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 02:46:03 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Marking volume ff3f49df-60f7-4187-8425-0f1410f51698 as bootable. {{(pid=87238) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 02:46:03 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Copying metadata from image a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df to ff3f49df-60f7-4187-8425-0f1410f51698. {{(pid=87238) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 02:46:03 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Creating volume glance metadata for volume ff3f49df-60f7-4187-8425-0f1410f51698 backed by image a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df with: {'image_id': 'a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df', 'image_name': 'tempest-scenario-img--390454588', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87238) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 02:46:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dea50a1-f172-442a-b1b6-87de3f06c105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff3f49df-60f7-4187-8425-0f1410f51698', 'volume_size': 1, 'image_id': 'a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--390454588', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '095fbfe5ecb34a859d0b8099c3f17a0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df', 'created_at': datetime.datetime(2026, 7, 8, 0, 45, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 45, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5a7e0bd-d0d3-4f11-a429-54e52fe0c1df/file', 'properties': {}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73aab7d0-bb7d-49a7-a04e-983dc2d5650a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:03 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Volume volume-ff3f49df-60f7-4187-8425-0f1410f51698 (ff3f49df-60f7-4187-8425-0f1410f51698): created successfully Jul 08 02:46:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73aab7d0-bb7d-49a7-a04e-983dc2d5650a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Flow 'volume_create_manager' (72762036-8414-4be7-9fa0-d8786141bf42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:46:03 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5d3de046-8867-4e0e-8de0-b801dd8fd0ce tempest-TestInstancesWithCinderVolumes-1446990626 None] Created volume successfully. Jul 08 02:46:04 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.641566f7-2ad8-4e18-88ea-3ec187fea369_1ghsmcw.img" returned: 1 in 0.832s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.641566f7-2ad8-4e18-88ea-3ec187fea369_1ghsmcw.img' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:46:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.641566f7-2ad8-4e18-88ea-3ec187fea369_1ghsmcw.img /opt/stack/data/cinder/conversion/vol_upload_79vl2wt8 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:04 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.641566f7-2ad8-4e18-88ea-3ec187fea369_1ghsmcw.img /opt/stack/data/cinder/conversion/vol_upload_79vl2wt8 Jul 08 02:46:04 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:04 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.641566f7-2ad8-4e18-88ea-3ec187fea369_1ghsmcw.img /opt/stack/data/cinder/conversion/vol_upload_79vl2wt8" returned: 0 in 0.752s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:04 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Image conversion details: src /opt/stack/data/cinder/conversion/8ff3baf4-be62-413b-bf93-87c28cc63e8c.temp_image.641566f7-2ad8-4e18-88ea-3ec187fea369_1ghsmcw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_79vl2wt8 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:46:04 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 08 02:46:04 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[4920e7b6-d61c-45a0-82ae-0c05fcbe04a1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_79vl2wt8 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:04 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_79vl2wt8 Jul 08 02:46:04 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:05 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_79vl2wt8" returned: 0 in 0.840s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.848s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Uploaded volume to glance image-id: 641566f7-2ad8-4e18-88ea-3ec187fea369. {{(pid=87238) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 02:46:07 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-6f685b2a-13e3-43b8-aef8-a0249e5f0a20 tempest-VolumesActionsTest-46122221 None] Copy volume to image completed successfully. Jul 08 02:46:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Acquiring lock "cinder-8ff3baf4-be62-413b-bf93-87c28cc63e8c-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:46:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Lock "cinder-8ff3baf4-be62-413b-bf93-87c28cc63e8c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:46:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Acquiring lock "cinder-quobyte-8ff3baf4-be62-413b-bf93-87c28cc63e8c" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:46:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Lock "cinder-quobyte-8ff3baf4-be62-413b-bf93-87c28cc63e8c" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:46:08 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f2f5c6-f805-4210-82f6-b11b2f24e8fb]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:09 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c Jul 08 02:46:09 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:09 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c" returned: 0 in 0.733s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:09 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c Jul 08 02:46:09 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:10 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ff3baf4-be62-413b-bf93-87c28cc63e8c" returned: 0 in 0.676s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Lock "cinder-quobyte-8ff3baf4-be62-413b-bf93-87c28cc63e8c" released by "delete_volume" :: held 1.448s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:46:10 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Created reservations ['8fdd41ad-ac7c-4b14-ab24-941908218cbe', 'a6b33595-9eac-41aa-9701-41af5f91a6b4', '918c285f-cee5-4b21-98b2-6b05a864c8cf', 'b889e54e-1d0d-4fba-b8e5-92cd517e8492'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:46:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:46:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:46:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:10 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:46:10 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:11 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.165s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:11 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:46:11 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Deleted volume successfully. Jul 08 02:46:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2cdcc2eb-3558-47fb-8603-34ba0822227d tempest-VolumesActionsTest-46122221 None] Lock "cinder-8ff3baf4-be62-413b-bf93-87c28cc63e8c-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:46:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-30e691fd-bedd-439c-b4b7-e16cd4a8f3ed req-31ad7757-6c0a-450d-aa8f-275cd5e15461 tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-30e691fd-bedd-439c-b4b7-e16cd4a8f3ed req-31ad7757-6c0a-450d-aa8f-275cd5e15461 tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:12 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[327761e9-c0b0-4954-9ba5-74ac33b795a2]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-30e691fd-bedd-439c-b4b7-e16cd4a8f3ed req-31ad7757-6c0a-450d-aa8f-275cd5e15461 tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:12 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 Jul 08 02:46:12 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:13 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-30e691fd-bedd-439c-b4b7-e16cd4a8f3ed req-31ad7757-6c0a-450d-aa8f-275cd5e15461 tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698" returned: 0 in 1.243s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-30e691fd-bedd-439c-b4b7-e16cd4a8f3ed req-31ad7757-6c0a-450d-aa8f-275cd5e15461 tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:13 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 Jul 08 02:46:13 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:14 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-30e691fd-bedd-439c-b4b7-e16cd4a8f3ed req-31ad7757-6c0a-450d-aa8f-275cd5e15461 tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698" returned: 1 in 0.954s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-30e691fd-bedd-439c-b4b7-e16cd4a8f3ed req-31ad7757-6c0a-450d-aa8f-275cd5e15461 tempest-TestInstancesWithCinderVolumes-1446990626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:46:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-30e691fd-bedd-439c-b4b7-e16cd4a8f3ed req-31ad7757-6c0a-450d-aa8f-275cd5e15461 tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.284s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-30e691fd-bedd-439c-b4b7-e16cd4a8f3ed req-31ad7757-6c0a-450d-aa8f-275cd5e15461 tempest-TestInstancesWithCinderVolumes-1446990626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-ff3f49df-60f7-4187-8425-0f1410f51698', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88b9c15d-3ebc-4b85-ad80-fc8f42ee1b01', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:46:14 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-30e691fd-bedd-439c-b4b7-e16cd4a8f3ed req-31ad7757-6c0a-450d-aa8f-275cd5e15461 tempest-TestInstancesWithCinderVolumes-1446990626 None] attachment_update completed successfully. Jul 08 02:46:17 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:46:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Flow 'volume_create_manager' (f26c1a66-b2bf-41ac-a422-872f29987d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:46:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d1ec97-1cbd-4f51-b719-1e7b386880fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d1ec97-1cbd-4f51-b719-1e7b386880fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1745705753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a19274a-85b6-4f48-9b80-a2cd526f088d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8bed567d75c44e9e8ab1196c27aaae42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:46:18Z,use_quota=True,user_id='d48e78aa4bb545edb5f985d242d415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b650d79-7ba7-40b5-a521-6e6353d740c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b650d79-7ba7-40b5-a521-6e6353d740c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140b6c85-3c23-482d-8e2d-3908c00e8fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140b6c85-3c23-482d-8e2d-3908c00e8fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a19274a-85b6-4f48-9b80-a2cd526f088d', 'volume_name': 'volume-9a19274a-85b6-4f48-9b80-a2cd526f088d', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e43835-b6f1-47a7-bf7a-174e08a31619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e43835-b6f1-47a7-bf7a-174e08a31619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a10aff71-53ca-4c31-8b58-049527dbf1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:17 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Volume 9a19274a-85b6-4f48-9b80-a2cd526f088d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a19274a-85b6-4f48-9b80-a2cd526f088d', 'volume_size': 1} Jul 08 02:46:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1745705753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a19274a-85b6-4f48-9b80-a2cd526f088d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8bed567d75c44e9e8ab1196c27aaae42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:46:18Z,use_quota=True,user_id='d48e78aa4bb545edb5f985d242d415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:46:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Creating volume 9a19274a-85b6-4f48-9b80-a2cd526f088d {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:46:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:46:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:46:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:46:18 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:46:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9a19274a-85b6-4f48-9b80-a2cd526f088d 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:18 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9a19274a-85b6-4f48-9b80-a2cd526f088d 1073741824 Jul 08 02:46:18 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:19 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9a19274a-85b6-4f48-9b80-a2cd526f088d 1073741824" returned: 0 in 1.098s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9a19274a-85b6-4f48-9b80-a2cd526f088d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:19 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9a19274a-85b6-4f48-9b80-a2cd526f088d Jul 08 02:46:19 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:19 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9a19274a-85b6-4f48-9b80-a2cd526f088d" returned: 0 in 0.665s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:46:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a10aff71-53ca-4c31-8b58-049527dbf1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a19274a-85b6-4f48-9b80-a2cd526f088d', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818c626f-8a49-461d-82e0-4316c50fff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:19 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Volume volume-9a19274a-85b6-4f48-9b80-a2cd526f088d (9a19274a-85b6-4f48-9b80-a2cd526f088d): created successfully Jul 08 02:46:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818c626f-8a49-461d-82e0-4316c50fff3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Flow 'volume_create_manager' (f26c1a66-b2bf-41ac-a422-872f29987d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:46:19 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-1ee6c735-00be-4ee9-aadd-d3706d26b4a6 tempest-VolumesGetTest-942511531 None] Created volume successfully. Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Flow 'volume_create_manager' (2a8e8893-91df-49cb-9e70-beaf5dd0be1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d9008c-09c5-4d99-ab26-89676b80e1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d9008c-09c5-4d99-ab26-89676b80e1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:46:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1015322923',display_name='tempest-VolumesGetTest-Volume-1600134144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3ad8af-1213-4757-8622-055f872db5cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bed567d75c44e9e8ab1196c27aaae42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:46:21Z,use_quota=True,user_id='d48e78aa4bb545edb5f985d242d415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5991cb51-0fb8-4d2f-bc2b-48584a1642fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5991cb51-0fb8-4d2f-bc2b-48584a1642fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344299c5-7293-469d-8be6-55c369f9744d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344299c5-7293-469d-8be6-55c369f9744d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a3ad8af-1213-4757-8622-055f872db5cb', 'volume_name': 'volume-0a3ad8af-1213-4757-8622-055f872db5cb', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53325a0-a098-4489-830a-15ea4562d75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53325a0-a098-4489-830a-15ea4562d75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5261ea-304b-448f-a558-379d533ebdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:20 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Volume 0a3ad8af-1213-4757-8622-055f872db5cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a3ad8af-1213-4757-8622-055f872db5cb', 'volume_size': 1} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:46:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1015322923',display_name='tempest-VolumesGetTest-Volume-1600134144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3ad8af-1213-4757-8622-055f872db5cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bed567d75c44e9e8ab1196c27aaae42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:46:21Z,use_quota=True,user_id='d48e78aa4bb545edb5f985d242d415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Creating volume 0a3ad8af-1213-4757-8622-055f872db5cb {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:46:20 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:46:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0a3ad8af-1213-4757-8622-055f872db5cb 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:20 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0a3ad8af-1213-4757-8622-055f872db5cb 1073741824 Jul 08 02:46:20 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:21 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0a3ad8af-1213-4757-8622-055f872db5cb 1073741824" returned: 0 in 0.951s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0a3ad8af-1213-4757-8622-055f872db5cb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:21 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0a3ad8af-1213-4757-8622-055f872db5cb Jul 08 02:46:21 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:22 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0a3ad8af-1213-4757-8622-055f872db5cb" returned: 0 in 0.843s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:46:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5261ea-304b-448f-a558-379d533ebdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a3ad8af-1213-4757-8622-055f872db5cb', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9751dde9-bfde-47d4-bf7f-e47403ccaa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:22 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Volume volume-0a3ad8af-1213-4757-8622-055f872db5cb (0a3ad8af-1213-4757-8622-055f872db5cb): created successfully Jul 08 02:46:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9751dde9-bfde-47d4-bf7f-e47403ccaa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Flow 'volume_create_manager' (2a8e8893-91df-49cb-9e70-beaf5dd0be1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:46:22 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c150f816-f4d3-4515-82f8-f66b596760c9 tempest-VolumesGetTest-942511531 None] Created volume successfully. Jul 08 02:46:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Acquiring lock "cinder-0a3ad8af-1213-4757-8622-055f872db5cb-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:46:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Lock "cinder-0a3ad8af-1213-4757-8622-055f872db5cb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:46:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Acquiring lock "cinder-quobyte-0a3ad8af-1213-4757-8622-055f872db5cb" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:46:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-0a3ad8af-1213-4757-8622-055f872db5cb" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:46:24 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0e980e-f696-4739-ac9d-c90663c34e5a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0a3ad8af-1213-4757-8622-055f872db5cb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:24 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0a3ad8af-1213-4757-8622-055f872db5cb Jul 08 02:46:24 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:25 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0a3ad8af-1213-4757-8622-055f872db5cb" returned: 0 in 1.232s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0a3ad8af-1213-4757-8622-055f872db5cb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:25 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0a3ad8af-1213-4757-8622-055f872db5cb Jul 08 02:46:25 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:26 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-0a3ad8af-1213-4757-8622-055f872db5cb" returned: 0 in 0.963s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-0a3ad8af-1213-4757-8622-055f872db5cb" released by "delete_volume" :: held 2.272s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:46:26 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Created reservations ['b5601387-e973-4c2c-aa07-dfd328ab2522', 'b24106f5-b607-406a-bd2b-bfb93a8d15da', '6ecb7491-af55-411a-9899-48b0a344b03a', 'af20cfae-9000-40ff-b12c-535915455151'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:46:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:46:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:46:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:26 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:46:26 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Acquiring lock "cinder-9a19274a-85b6-4f48-9b80-a2cd526f088d-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:46:27 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.141s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:27 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:46:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Lock "cinder-9a19274a-85b6-4f48-9b80-a2cd526f088d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:46:27 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Deleted volume successfully. Jul 08 02:46:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7941cda7-22f0-4082-a151-35048a93c153 tempest-VolumesGetTest-942511531 None] Lock "cinder-0a3ad8af-1213-4757-8622-055f872db5cb-delete_volume" released by "delete_volume" :: held 3.754s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:46:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Acquiring lock "cinder-quobyte-9a19274a-85b6-4f48-9b80-a2cd526f088d" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:46:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-9a19274a-85b6-4f48-9b80-a2cd526f088d" acquired by "delete_volume" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:46:28 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e143cd9-1fda-4e8a-9901-cafdc2a9985a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9a19274a-85b6-4f48-9b80-a2cd526f088d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:28 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9a19274a-85b6-4f48-9b80-a2cd526f088d Jul 08 02:46:28 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9a19274a-85b6-4f48-9b80-a2cd526f088d" returned: 0 in 1.246s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:29 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9a19274a-85b6-4f48-9b80-a2cd526f088d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:29 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9a19274a-85b6-4f48-9b80-a2cd526f088d Jul 08 02:46:29 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:30 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9a19274a-85b6-4f48-9b80-a2cd526f088d" returned: 0 in 0.804s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:30 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-9a19274a-85b6-4f48-9b80-a2cd526f088d" released by "delete_volume" :: held 2.102s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:46:30 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Created reservations ['b4e4988b-7574-48a4-87e7-82c3620606f5', 'fd7774fa-977b-4ee7-8f6d-2bfcaef10894', '78286deb-8d68-465f-9fc0-7e5e57622e4f', '7d523dd8-b3b2-4cc7-9be4-d1382984c3cc'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:46:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:46:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:46:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:30 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:46:30 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:31 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.714s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:31 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:46:31 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Deleted volume successfully. Jul 08 02:46:31 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c7573f21-cdb8-4a7e-9d2d-f3af904c5c75 tempest-VolumesGetTest-942511531 None] Lock "cinder-9a19274a-85b6-4f48-9b80-a2cd526f088d-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:46:31 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Flow 'volume_create_manager' (5f3d7cee-ddc0-4f80-8d4a-e1f231873a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5f2ebb-fdf4-476b-ae7a-2fbd1ac3a734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5f2ebb-fdf4-476b-ae7a-2fbd1ac3a734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1577023154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6161dba5-fcba-4c52-ab6f-0956d14d9a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bed567d75c44e9e8ab1196c27aaae42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:46:32Z,use_quota=True,user_id='d48e78aa4bb545edb5f985d242d415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072188b4-9c1d-4687-951f-c03c8cb31da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072188b4-9c1d-4687-951f-c03c8cb31da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd9b7d7-7bc5-47f4-b518-ab40bde8b8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd9b7d7-7bc5-47f4-b518-ab40bde8b8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6161dba5-fcba-4c52-ab6f-0956d14d9a6b', 'volume_name': 'volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db497a3e-59cc-471e-ada7-b7bf30421d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db497a3e-59cc-471e-ada7-b7bf30421d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ccb7da-86d9-479a-8288-774d0e4d3548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:32 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Volume 6161dba5-fcba-4c52-ab6f-0956d14d9a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b', 'volume_size': 1} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1577023154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6161dba5-fcba-4c52-ab6f-0956d14d9a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bed567d75c44e9e8ab1196c27aaae42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:46:32Z,use_quota=True,user_id='d48e78aa4bb545edb5f985d242d415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Creating volume 6161dba5-fcba-4c52-ab6f-0956d14d9a6b {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:46:32 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:46:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:32 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b 1073741824 Jul 08 02:46:32 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:33 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b 1073741824" returned: 0 in 1.078s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:33 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b Jul 08 02:46:33 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:33 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b" returned: 0 in 0.743s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:46:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ccb7da-86d9-479a-8288-774d0e4d3548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d80239-a49d-4fd6-8b51-ecf6d4076864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:34 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Volume volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b (6161dba5-fcba-4c52-ab6f-0956d14d9a6b): created successfully Jul 08 02:46:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d80239-a49d-4fd6-8b51-ecf6d4076864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Flow 'volume_create_manager' (5f3d7cee-ddc0-4f80-8d4a-e1f231873a39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:46:34 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a35aea7d-738b-4e18-8d5e-4311eb63ed4b tempest-VolumesGetTest-942511531 None] Created volume successfully. Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=36,cinder:UPDATE=47,cinder:INSERT=13,cinder:DELETE=6 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=47,cinder:SELECT=49,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Flow 'volume_create_manager' (cb2be168-714e-4aa2-bea0-8822da64c613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1af701-fd24-4967-802e-5d2969dcb8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1af701-fd24-4967-802e-5d2969dcb8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-378970942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a142c5-61b1-4d7d-b19d-6ca6211b604b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8bed567d75c44e9e8ab1196c27aaae42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6161dba5-fcba-4c52-ab6f-0956d14d9a6b,status='creating',terminated_at=None,updated_at=2026-07-08T00:46:36Z,use_quota=True,user_id='d48e78aa4bb545edb5f985d242d415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e089922b-ecf4-4844-8dba-9c145617be04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e089922b-ecf4-4844-8dba-9c145617be04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13931573-1152-471b-8aab-3813257e1729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13931573-1152-471b-8aab-3813257e1729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '89a142c5-61b1-4d7d-b19d-6ca6211b604b', 'volume_name': 'volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b', 'volume_size': 1, 'source_volid': '6161dba5-fcba-4c52-ab6f-0956d14d9a6b', 'source_volstatus': 'available'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd4dd71-d666-4206-a8d3-ba3e400a2ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd4dd71-d666-4206-a8d3-ba3e400a2ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12db24dd-4e91-4112-b6e1-27cf428e2c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:35 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Volume 89a142c5-61b1-4d7d-b19d-6ca6211b604b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b', 'volume_size': 1, 'source_volid': '6161dba5-fcba-4c52-ab6f-0956d14d9a6b', 'source_volstatus': 'available'} Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:35 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Cloning volume 6161dba5-fcba-4c52-ab6f-0956d14d9a6b to volume 89a142c5-61b1-4d7d-b19d-6ca6211b604b Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Creating offline snapshot 76a42e75-28f4-42a2-a8fc-28da53edd545 of volume 6161dba5-fcba-4c52-ab6f-0956d14d9a6b {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaec078-eb6c-4c8d-abba-3286a62f9e05]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:36 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b Jul 08 02:46:36 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:36 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b" returned: 0 in 0.951s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:36 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 1G Jul 08 02:46:36 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:37 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 1G" returned: 0 in 0.874s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:37 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 Jul 08 02:46:37 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:38 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545" returned: 0 in 0.703s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:38 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 is being set with open permissions: ugo+rw Jul 08 02:46:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:38 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 Jul 08 02:46:38 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:39 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545" returned: 0 in 0.646s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:39 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.info Jul 08 02:46:39 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:39 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.info" returned: 0 in 0.658s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:39 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.info is being set with open permissions: ugo+rw Jul 08 02:46:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:39 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.info Jul 08 02:46:39 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:40 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.info" returned: 0 in 0.639s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:40 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Acquiring lock "cinder-quobyte-89a142c5-61b1-4d7d-b19d-6ca6211b604b" by "_copy_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:46:40 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-89a142c5-61b1-4d7d-b19d-6ca6211b604b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:46:40 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] snapshot: 76a42e75-28f4-42a2-a8fc-28da53edd545, volume: 89a142c5-61b1-4d7d-b19d-6ca6211b604b, {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 02:46:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:40 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:46:40 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:46:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:40 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cabbc99-7c27-46b4-8e23-1bd7a6556232]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:40 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 Jul 08 02:46:40 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:41 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545" returned: 0 in 0.790s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:46:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 02:46:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Creating direct copy from snapshot {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 02:46:41 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[786e126f-8933-4afa-a6d7-789758bf90af]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:41 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b Jul 08 02:46:41 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:42 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b" returned: 0 in 0.856s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:42 devstack cinder-volume[87238]: DEBUG cinder.utils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Path /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b not found in is_blk_device check {{(pid=87238) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 02:46:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:42 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b Jul 08 02:46:42 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:46:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:46:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:46:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:47 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:46:47 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:48 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b" returned: 0 in 6.333s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:48 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.294s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:46:48 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7c21e7-ca7d-43a6-a9b4-7bb67933d658]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:46:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:46:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:46:48 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b Jul 08 02:46:48 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:49 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:46:49 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=5,cinder:INSERT=1 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:46:49 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b" returned: 0 in 1.074s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:49 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:46:49 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Converted 1024.00 MB image at 161.65 MB/s Jul 08 02:46:49 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b is being set with open permissions: ugo+rw Jul 08 02:46:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:49 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b Jul 08 02:46:49 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:50 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b" returned: 0 in 0.631s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-89a142c5-61b1-4d7d-b19d-6ca6211b604b" released by "_copy_volume_from_snapshot" :: held 9.793s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:46:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Acquiring lock "cinder-quobyte-76a42e75-28f4-42a2-a8fc-28da53edd545" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:46:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-76a42e75-28f4-42a2-a8fc-28da53edd545" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:46:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Deleting offline snapshot 76a42e75-28f4-42a2-a8fc-28da53edd545 of volume 6161dba5-fcba-4c52-ab6f-0956d14d9a6b {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:46:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] snapshot_file for this snap is: volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:46:50 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[906e6dc9-a940-49df-a940-0934ec6f1773]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:50 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 Jul 08 02:46:50 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:51 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545" returned: 0 in 0.840s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:46:51 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b00dbd-20b9-4709-b14b-74e83cd103b8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:51 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b Jul 08 02:46:51 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:52 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b" returned: 0 in 0.881s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:52 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 Jul 08 02:46:52 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:52 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545" returned: 0 in 0.839s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:52 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545 Jul 08 02:46:52 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:53 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b.76a42e75-28f4-42a2-a8fc-28da53edd545" returned: 0 in 0.725s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-76a42e75-28f4-42a2-a8fc-28da53edd545" released by "_delete_snapshot" :: held 3.397s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:46:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.872s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12db24dd-4e91-4112-b6e1-27cf428e2c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b', 'volume_size': 1, 'source_volid': '6161dba5-fcba-4c52-ab6f-0956d14d9a6b', 'source_volstatus': 'available'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed41fa0a-b486-4d81-9af2-626d32fddb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:53 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Volume volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b (89a142c5-61b1-4d7d-b19d-6ca6211b604b): created successfully Jul 08 02:46:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed41fa0a-b486-4d81-9af2-626d32fddb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Flow 'volume_create_manager' (cb2be168-714e-4aa2-bea0-8822da64c613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:46:53 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-113c9a48-eb7a-4d2f-b726-eb16176ce128 tempest-VolumesGetTest-942511531 None] Created volume successfully. Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Flow 'volume_create_manager' (ae8912ad-bfbe-4c85-bace-0be723e92e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7188ca7c-f43e-45ee-a947-02150098c7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7188ca7c-f43e-45ee-a947-02150098c7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:46:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1716505449',display_name='tempest-VolumesGetTest-Volume-148594913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e36b658-6972-49e0-95b9-e091036b87f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bed567d75c44e9e8ab1196c27aaae42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:46:55Z,use_quota=True,user_id='d48e78aa4bb545edb5f985d242d415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960362f8-5fe2-4b3e-a364-9c92ef3a3ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960362f8-5fe2-4b3e-a364-9c92ef3a3ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48327379-ac8b-46df-95d5-aad0976c0645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48327379-ac8b-46df-95d5-aad0976c0645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e36b658-6972-49e0-95b9-e091036b87f9', 'volume_name': 'volume-1e36b658-6972-49e0-95b9-e091036b87f9', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e276ea-23c5-4972-819f-a0f8acbac0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e276ea-23c5-4972-819f-a0f8acbac0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632ea682-0f7b-40e7-8ed9-57daab32e071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:55 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Volume 1e36b658-6972-49e0-95b9-e091036b87f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e36b658-6972-49e0-95b9-e091036b87f9', 'volume_size': 1} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:46:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1716505449',display_name='tempest-VolumesGetTest-Volume-148594913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e36b658-6972-49e0-95b9-e091036b87f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bed567d75c44e9e8ab1196c27aaae42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:46:55Z,use_quota=True,user_id='d48e78aa4bb545edb5f985d242d415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Creating volume 1e36b658-6972-49e0-95b9-e091036b87f9 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:46:55 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1e36b658-6972-49e0-95b9-e091036b87f9 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:55 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1e36b658-6972-49e0-95b9-e091036b87f9 1073741824 Jul 08 02:46:55 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-2fb9ce1c-820b-4698-b3da-bb77ca30c47d req-6aa6d089-99dd-4741-97b7-cd7ede251614 tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:56 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1e36b658-6972-49e0-95b9-e091036b87f9 1073741824" returned: 0 in 0.875s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1e36b658-6972-49e0-95b9-e091036b87f9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:56 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1e36b658-6972-49e0-95b9-e091036b87f9 Jul 08 02:46:56 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:56 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1e36b658-6972-49e0-95b9-e091036b87f9" returned: 0 in 0.647s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:46:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-2fb9ce1c-820b-4698-b3da-bb77ca30c47d req-6aa6d089-99dd-4741-97b7-cd7ede251614 tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.382s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632ea682-0f7b-40e7-8ed9-57daab32e071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e36b658-6972-49e0-95b9-e091036b87f9', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caaa2306-3360-4dad-8cc8-ce5eaad8dc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:46:56 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac2de09-9b06-4d79-8656-c5ab98676d09]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-2fb9ce1c-820b-4698-b3da-bb77ca30c47d req-6aa6d089-99dd-4741-97b7-cd7ede251614 tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8975ddc-3425-4dbc-9282-3f61199f148a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:56 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Volume volume-1e36b658-6972-49e0-95b9-e091036b87f9 (1e36b658-6972-49e0-95b9-e091036b87f9): created successfully Jul 08 02:46:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caaa2306-3360-4dad-8cc8-ce5eaad8dc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:46:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Flow 'volume_create_manager' (ae8912ad-bfbe-4c85-bace-0be723e92e6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:46:56 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-df4cbeb6-c209-4420-9a80-22418a7087d7 tempest-VolumesGetTest-942511531 None] Created volume successfully. Jul 08 02:46:56 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8975ddc-3425-4dbc-9282-3f61199f148a Jul 08 02:46:56 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Acquiring lock "cinder-1e36b658-6972-49e0-95b9-e091036b87f9-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:46:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Lock "cinder-1e36b658-6972-49e0-95b9-e091036b87f9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:46:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Acquiring lock "cinder-quobyte-1e36b658-6972-49e0-95b9-e091036b87f9" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:46:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-1e36b658-6972-49e0-95b9-e091036b87f9" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:46:57 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7fdaff-0e02-49ca-89b7-bd29abe3f103]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1e36b658-6972-49e0-95b9-e091036b87f9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:57 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1e36b658-6972-49e0-95b9-e091036b87f9 Jul 08 02:46:57 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:57 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-2fb9ce1c-820b-4698-b3da-bb77ca30c47d req-6aa6d089-99dd-4741-97b7-cd7ede251614 tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8975ddc-3425-4dbc-9282-3f61199f148a" returned: 0 in 0.841s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-2fb9ce1c-820b-4698-b3da-bb77ca30c47d req-6aa6d089-99dd-4741-97b7-cd7ede251614 tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.876s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-2fb9ce1c-820b-4698-b3da-bb77ca30c47d req-6aa6d089-99dd-4741-97b7-cd7ede251614 tempest-TestInstancesWithCinderVolumes-1446990626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-c8975ddc-3425-4dbc-9282-3f61199f148a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a4255d5-7d34-4d8e-9a1e-d450726a56d3', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:46:57 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-2fb9ce1c-820b-4698-b3da-bb77ca30c47d req-6aa6d089-99dd-4741-97b7-cd7ede251614 tempest-TestInstancesWithCinderVolumes-1446990626 None] attachment_update completed successfully. Jul 08 02:46:58 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1e36b658-6972-49e0-95b9-e091036b87f9" returned: 0 in 0.786s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1e36b658-6972-49e0-95b9-e091036b87f9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:58 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1e36b658-6972-49e0-95b9-e091036b87f9 Jul 08 02:46:58 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:58 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1e36b658-6972-49e0-95b9-e091036b87f9" returned: 0 in 0.681s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-1e36b658-6972-49e0-95b9-e091036b87f9" released by "delete_volume" :: held 1.506s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:46:59 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Created reservations ['57a07173-4a85-4413-ab2e-a3658b33e63b', '583bf85b-bcac-46ac-8715-1a588a82b4c7', '93716fec-9a08-4b77-ae46-a86b8286730e', '9e6bae4c-a60a-4bcb-8ace-37170dedeb53'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:46:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:46:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:46:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:46:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:46:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:46:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:59 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:46:59 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:46:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Acquiring lock "cinder-89a142c5-61b1-4d7d-b19d-6ca6211b604b-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:46:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Lock "cinder-89a142c5-61b1-4d7d-b19d-6ca6211b604b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:46:59 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jul 08 02:46:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.652s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:46:59 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:46:59 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Deleted volume successfully. Jul 08 02:46:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Acquiring lock "cinder-quobyte-89a142c5-61b1-4d7d-b19d-6ca6211b604b" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:46:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32f36abb-230a-47ab-aa0a-dadc4d919012 tempest-VolumesGetTest-942511531 None] Lock "cinder-1e36b658-6972-49e0-95b9-e091036b87f9-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:46:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-89a142c5-61b1-4d7d-b19d-6ca6211b604b" acquired by "delete_volume" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:46:59 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7707024e-1af7-4e99-bad7-2762dc43a7f8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:46:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:46:59 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b Jul 08 02:46:59 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:00 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b" returned: 0 in 0.780s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:00 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b Jul 08 02:47:00 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:01 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89a142c5-61b1-4d7d-b19d-6ca6211b604b" returned: 0 in 0.652s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:01 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-89a142c5-61b1-4d7d-b19d-6ca6211b604b" released by "delete_volume" :: held 1.475s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:01 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Created reservations ['e7fe37d4-36a8-4ccb-9370-1057e0fa7840', '8702eb5f-7348-48db-ae02-cb4b47babf30', '2bb7f4ef-d5dc-411b-97c8-87c123a57022', '8ad42b9f-923d-4ec7-b025-b29f74423d34'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:47:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:47:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:47:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:01 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:47:01 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Acquiring lock "cinder-6161dba5-fcba-4c52-ab6f-0956d14d9a6b-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Lock "cinder-6161dba5-fcba-4c52-ab6f-0956d14d9a6b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Acquiring lock "cinder-quobyte-6161dba5-fcba-4c52-ab6f-0956d14d9a6b" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-6161dba5-fcba-4c52-ab6f-0956d14d9a6b" acquired by "delete_volume" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:02 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1379b63f-4414-460f-a858-44fc74befb70]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:02 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.866s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:02 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:47:02 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Deleted volume successfully. Jul 08 02:47:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-29ddc665-af9d-4664-86b0-12434ca7bf2f tempest-VolumesGetTest-942511531 None] Lock "cinder-89a142c5-61b1-4d7d-b19d-6ca6211b604b-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:02 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b Jul 08 02:47:02 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:03 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b" returned: 0 in 0.862s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:03 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b Jul 08 02:47:03 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:03 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6161dba5-fcba-4c52-ab6f-0956d14d9a6b" returned: 0 in 0.662s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:03 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-6161dba5-fcba-4c52-ab6f-0956d14d9a6b" released by "delete_volume" :: held 1.589s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:03 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Created reservations ['5a6959f2-b5be-402f-ad41-c92c70d1039a', 'e4028835-0040-4407-9c6f-ade95309b9fc', 'b7cee6d7-d07b-4e5b-b6ad-1ccd0a58ae5f', '819a1af4-8d55-400d-a079-a36a0e19ff34'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:47:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:47:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:47:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:03 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:47:03 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:04 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.712s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:04 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:47:04 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Deleted volume successfully. Jul 08 02:47:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e5606ccc-ea71-4af9-9b22-dd12f2eec7d2 tempest-VolumesGetTest-942511531 None] Lock "cinder-6161dba5-fcba-4c52-ab6f-0956d14d9a6b-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-c065c893-b45e-4393-9d8b-a33946577a43 req-c89039d4-aab9-412f-92d2-ef35e966f734 tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-c065c893-b45e-4393-9d8b-a33946577a43 req-c89039d4-aab9-412f-92d2-ef35e966f734 tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Flow 'volume_create_manager' (4605c9a7-2c3f-44ab-8216-66bcdde2d3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caca9176-7156-4835-adcf-ced3a3b4c4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab0376e-3b60-4201-b4bc-d34552294fdb]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-c065c893-b45e-4393-9d8b-a33946577a43 req-c89039d4-aab9-412f-92d2-ef35e966f734 tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d4628bba-631b-42a7-a9a2-6399504a4703 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caca9176-7156-4835-adcf-ced3a3b4c4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1529834431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c7a3a4-7231-4d53-8289-1a0d54b9e16b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8bed567d75c44e9e8ab1196c27aaae42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:47:05Z,use_quota=True,user_id='d48e78aa4bb545edb5f985d242d415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49fa9d1-d6cc-470b-b2b8-eb7eaeee0619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49fa9d1-d6cc-470b-b2b8-eb7eaeee0619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75980e17-0b0b-4888-a9ea-a2b51939f4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG cinder.image.glance [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Creating Keystone auth plugin from conf {{(pid=87238) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 02:47:05 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d4628bba-631b-42a7-a9a2-6399504a4703 Jul 08 02:47:05 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75980e17-0b0b-4888-a9ea-a2b51939f4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '39c7a3a4-7231-4d53-8289-1a0d54b9e16b', 'volume_name': 'volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b', 'volume_size': 1, 'image_id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a21b7084cd94a8dbdfabbb9ed31db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'created_at': datetime.datetime(2026, 7, 8, 0, 29, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 29, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d652479-1a49-4785-9fa6-62d5f48b409f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbdbcb9-d912-4479-88ce-309ea4823857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbdbcb9-d912-4479-88ce-309ea4823857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec6badd-624b-4d8b-88ab-fec87a2f973d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:05 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Volume 39c7a3a4-7231-4d53-8289-1a0d54b9e16b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b', 'volume_size': 1, 'image_id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a21b7084cd94a8dbdfabbb9ed31db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'created_at': datetime.datetime(2026, 7, 8, 0, 29, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 29, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d652479-1a49-4785-9fa6-62d5f48b409f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Trying to clone 39c7a3a4-7231-4d53-8289-1a0d54b9e16b from image 9d652479-1a49-4785-9fa6-62d5f48b409f at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}]). {{(pid=87238) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_8miw07kkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 02:47:05 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Image download 20.69 MB at 20.69 MB/s Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[864807f3-2a5f-4f59-918a-0b28c3114e69]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_8miw07kkdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:05 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-c065c893-b45e-4393-9d8b-a33946577a43 req-c89039d4-aab9-412f-92d2-ef35e966f734 tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d4628bba-631b-42a7-a9a2-6399504a4703" returned: 0 in 0.833s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-c065c893-b45e-4393-9d8b-a33946577a43 req-c89039d4-aab9-412f-92d2-ef35e966f734 tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.872s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-c065c893-b45e-4393-9d8b-a33946577a43 req-c89039d4-aab9-412f-92d2-ef35e966f734 tempest-TestInstancesWithCinderVolumes-1446990626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-d4628bba-631b-42a7-a9a2-6399504a4703', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22326e51-4ec3-45e1-a89e-9f6c17a12d6c', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:47:06 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-c065c893-b45e-4393-9d8b-a33946577a43 req-c89039d4-aab9-412f-92d2-ef35e966f734 tempest-TestInstancesWithCinderVolumes-1446990626 None] attachment_update completed successfully. Jul 08 02:47:06 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_8miw07kkdevstack@QuobyteHD Jul 08 02:47:06 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:06 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_8miw07kkdevstack@QuobyteHD" returned: 0 in 0.745s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:06 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Temporary image 9d652479-1a49-4785-9fa6-62d5f48b409f is fetched for user d48e78aa4bb545edb5f985d242d415b8. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 02:47:06 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[76636ab4-54fe-4418-a7c4-d50c2412d41d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_8miw07kkdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:06 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_8miw07kkdevstack@QuobyteHD Jul 08 02:47:06 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:07 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_8miw07kkdevstack@QuobyteHD" returned: 0 in 0.783s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1529834431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c7a3a4-7231-4d53-8289-1a0d54b9e16b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8bed567d75c44e9e8ab1196c27aaae42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:47:05Z,use_quota=True,user_id='d48e78aa4bb545edb5f985d242d415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:47:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Creating volume 39c7a3a4-7231-4d53-8289-1a0d54b9e16b {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:47:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:47:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:47:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:47:07 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:47:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:07 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b 1073741824 Jul 08 02:47:07 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:08 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b 1073741824" returned: 0 in 0.833s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:08 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b Jul 08 02:47:08 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:09 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b" returned: 0 in 0.653s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:47:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:09 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Attempting download of 9d652479-1a49-4785-9fa6-62d5f48b409f ((None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}])) to volume 39c7a3a4-7231-4d53-8289-1a0d54b9e16b. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 02:47:09 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f19560-9293-4d8e-8dee-d3fe0b7a527e]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_8ovw1zg1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:09 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_8ovw1zg1 Jul 08 02:47:09 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:09 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_8ovw1zg1" returned: 0 in 0.787s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_8ovw1zg1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:10 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_8ovw1zg1 Jul 08 02:47:10 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:10 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_8ovw1zg1" returned: 1 in 0.937s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_8ovw1zg1' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:47:10 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e868d3-248d-444e-92cb-6dcd1770360d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_8miw07kkdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:11 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_8miw07kkdevstack@QuobyteHD Jul 08 02:47:11 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:11 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_8miw07kkdevstack@QuobyteHD" returned: 0 in 0.818s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:11 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] 9d652479-1a49-4785-9fa6-62d5f48b409f was qcow2, converting to raw {{(pid=87238) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 02:47:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_8miw07kkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:11 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_8miw07kkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b Jul 08 02:47:11 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:13 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_8miw07kkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b" returned: 0 in 1.984s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:13 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_8miw07kkdevstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:47:13 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Converted 112.00 MB image at 56.42 MB/s Jul 08 02:47:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:13 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b 1G Jul 08 02:47:13 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Flow 'volume_create_manager' (858bbb64-ce44-4646-b164-b68e104a6b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1139d3ff-477e-4fb6-83dc-151b4a5707e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1139d3ff-477e-4fb6-83dc-151b4a5707e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-384820542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23cf9222-edec-476b-a00d-eb0dbc7bde05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f1f3c8272a14b28b87f9be697b8e9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:47:14Z,use_quota=True,user_id='577c9c242a7c466eb4f0a2928c7313a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6ea0da-0141-4d7a-8794-dd83e950db66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6ea0da-0141-4d7a-8794-dd83e950db66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723e65a9-16cf-4225-ac9c-699bd0c43160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723e65a9-16cf-4225-ac9c-699bd0c43160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23cf9222-edec-476b-a00d-eb0dbc7bde05', 'volume_name': 'volume-23cf9222-edec-476b-a00d-eb0dbc7bde05', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced7030b-425a-4844-abed-977a26961411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced7030b-425a-4844-abed-977a26961411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893dc1d4-d5e8-40a9-a23e-325f73b838e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:14 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Volume 23cf9222-edec-476b-a00d-eb0dbc7bde05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23cf9222-edec-476b-a00d-eb0dbc7bde05', 'volume_size': 1} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-384820542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23cf9222-edec-476b-a00d-eb0dbc7bde05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f1f3c8272a14b28b87f9be697b8e9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:47:14Z,use_quota=True,user_id='577c9c242a7c466eb4f0a2928c7313a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Creating volume 23cf9222-edec-476b-a00d-eb0dbc7bde05 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:47:14 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23cf9222-edec-476b-a00d-eb0dbc7bde05 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:14 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23cf9222-edec-476b-a00d-eb0dbc7bde05 1073741824 Jul 08 02:47:14 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:14 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b 1G" returned: 0 in 0.751s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0690c9f4-3b88-4f37-ba1b-7a283483cc68]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:14 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b Jul 08 02:47:14 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:14 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23cf9222-edec-476b-a00d-eb0dbc7bde05 1073741824" returned: 0 in 0.829s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23cf9222-edec-476b-a00d-eb0dbc7bde05 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:15 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23cf9222-edec-476b-a00d-eb0dbc7bde05 Jul 08 02:47:15 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:15 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-bca55dfb-e1aa-40b3-b3b1-b9964a00e0bf req-f5a54402-7ddf-41e1-94ee-e60a187b45bb tempest-TestInstancesWithCinderVolumes-1446990626 None] Terminate volume connection completed successfully. Jul 08 02:47:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-bca55dfb-e1aa-40b3-b3b1-b9964a00e0bf req-f5a54402-7ddf-41e1-94ee-e60a187b45bb tempest-TestInstancesWithCinderVolumes-1446990626 None] Deleting attachment 4a4255d5-7d34-4d8e-9a1e-d450726a56d3. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:47:15 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b" returned: 0 in 0.815s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:15 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b Jul 08 02:47:15 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:15 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23cf9222-edec-476b-a00d-eb0dbc7bde05" returned: 0 in 0.661s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:47:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893dc1d4-d5e8-40a9-a23e-325f73b838e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23cf9222-edec-476b-a00d-eb0dbc7bde05', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73bcb7d8-f934-4fc8-8526-e86c2029844c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:15 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Volume volume-23cf9222-edec-476b-a00d-eb0dbc7bde05 (23cf9222-edec-476b-a00d-eb0dbc7bde05): created successfully Jul 08 02:47:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73bcb7d8-f934-4fc8-8526-e86c2029844c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Flow 'volume_create_manager' (858bbb64-ce44-4646-b164-b68e104a6b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:47:15 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5ae602a8-319c-4e25-8c00-263ed132d7ad tempest-AttachVolumeTestJSON-1302012325 None] Created volume successfully. Jul 08 02:47:16 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b" returned: 1 in 0.767s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:47:16 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Downloaded image 9d652479-1a49-4785-9fa6-62d5f48b409f ((None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}])) to volume 39c7a3a4-7231-4d53-8289-1a0d54b9e16b successfully. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 02:47:16 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Temporary image 9d652479-1a49-4785-9fa6-62d5f48b409f for user d48e78aa4bb545edb5f985d242d415b8 is deleted. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 02:47:16 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Marking volume 39c7a3a4-7231-4d53-8289-1a0d54b9e16b as bootable. {{(pid=87238) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 02:47:16 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Copying metadata from image 9d652479-1a49-4785-9fa6-62d5f48b409f to 39c7a3a4-7231-4d53-8289-1a0d54b9e16b. {{(pid=87238) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 02:47:16 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Creating volume glance metadata for volume 39c7a3a4-7231-4d53-8289-1a0d54b9e16b backed by image 9d652479-1a49-4785-9fa6-62d5f48b409f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87238) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 02:47:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec6badd-624b-4d8b-88ab-fec87a2f973d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b', 'volume_size': 1, 'image_id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a21b7084cd94a8dbdfabbb9ed31db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'created_at': datetime.datetime(2026, 7, 8, 0, 29, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 29, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d652479-1a49-4785-9fa6-62d5f48b409f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b353cd-be5a-4749-9804-6156657d0564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:16 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Volume volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b (39c7a3a4-7231-4d53-8289-1a0d54b9e16b): created successfully Jul 08 02:47:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b353cd-be5a-4749-9804-6156657d0564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Flow 'volume_create_manager' (4605c9a7-2c3f-44ab-8216-66bcdde2d3cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:47:16 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-7bec5254-51be-452c-9e71-e4b528a9c60d tempest-VolumesGetTest-942511531 None] Created volume successfully. Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "cinder-c8975ddc-3425-4dbc-9282-3f61199f148a-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "cinder-c8975ddc-3425-4dbc-9282-3f61199f148a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "cinder-quobyte-c8975ddc-3425-4dbc-9282-3f61199f148a" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "cinder-quobyte-c8975ddc-3425-4dbc-9282-3f61199f148a" acquired by "delete_volume" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca1b158-0d50-4694-ac1d-ec2db5515c5f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8975ddc-3425-4dbc-9282-3f61199f148a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:17 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8975ddc-3425-4dbc-9282-3f61199f148a Jul 08 02:47:17 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Flow 'volume_create_manager' (19cf5634-f0db-445b-81d1-66afd211e0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699cbdbe-b53a-46c2-92b5-23c0ea02c7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699cbdbe-b53a-46c2-92b5-23c0ea02c7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:47:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-861360496',display_name='tempest-VolumesGetTest-Volume-1702122643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bed567d75c44e9e8ab1196c27aaae42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:47:18Z,use_quota=True,user_id='d48e78aa4bb545edb5f985d242d415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e67b65f-b5cf-4fda-b427-f2ac9ce0736e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e67b65f-b5cf-4fda-b427-f2ac9ce0736e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0446af-d275-4e2f-bef8-5847519a4b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0446af-d275-4e2f-bef8-5847519a4b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1', 'volume_name': 'volume-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78823ae7-db88-4625-8a41-b1e238c2d3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78823ae7-db88-4625-8a41-b1e238c2d3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecaa50fe-f2cf-43e7-83f8-0df0b388c383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:17 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Volume aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1', 'volume_size': 1} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:47:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-861360496',display_name='tempest-VolumesGetTest-Volume-1702122643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bed567d75c44e9e8ab1196c27aaae42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:47:18Z,use_quota=True,user_id='d48e78aa4bb545edb5f985d242d415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Creating volume aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:47:17 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:47:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:17 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1 1073741824 Jul 08 02:47:17 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:18 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8975ddc-3425-4dbc-9282-3f61199f148a" returned: 0 in 0.814s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8975ddc-3425-4dbc-9282-3f61199f148a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:18 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8975ddc-3425-4dbc-9282-3f61199f148a Jul 08 02:47:18 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:18 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8975ddc-3425-4dbc-9282-3f61199f148a" returned: 0 in 0.701s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:18 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1 1073741824" returned: 0 in 1.057s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "cinder-quobyte-c8975ddc-3425-4dbc-9282-3f61199f148a" released by "delete_volume" :: held 1.569s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:19 devstack cinder-volume[87238]: WARNING cinder.quota [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-391631544-1044532283 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-391631544-1044532283, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:47:19 devstack cinder-volume[87238]: WARNING cinder.quota [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-391631544-1044532283 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-391631544-1044532283, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:47:19 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1 Jul 08 02:47:19 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Created reservations ['a3cc7aa9-d4bc-4ebc-9b1f-b967aef0c24e', 'b2d0fddf-24d9-4998-901c-c53c0433c9f1', '369dade0-60b6-4154-8c03-60aa0058fcde', '58fc1718-8d7d-43b1-9bd4-c6dabef41778'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:19 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:47:19 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-799244b1-9018-4782-a1b9-db4f1165a362 req-087fc58e-ce12-4bf9-b6f7-27f7f52e92ac tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:19 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1" returned: 0 in 0.710s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-799244b1-9018-4782-a1b9-db4f1165a362 req-087fc58e-ce12-4bf9-b6f7-27f7f52e92ac tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.332s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[763c1a70-6eeb-4796-a5ab-83c0ed285292]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-799244b1-9018-4782-a1b9-db4f1165a362 req-087fc58e-ce12-4bf9-b6f7-27f7f52e92ac tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23cf9222-edec-476b-a00d-eb0dbc7bde05 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecaa50fe-f2cf-43e7-83f8-0df0b388c383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70a4544-2644-45f4-9f03-43c587f9de39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:19 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Volume volume-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1 (aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1): created successfully Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70a4544-2644-45f4-9f03-43c587f9de39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Flow 'volume_create_manager' (19cf5634-f0db-445b-81d1-66afd211e0a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:47:19 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c4032230-5939-41fd-9ed1-a6ab1227f59e tempest-VolumesGetTest-942511531 None] Created volume successfully. Jul 08 02:47:19 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23cf9222-edec-476b-a00d-eb0dbc7bde05 Jul 08 02:47:19 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:19 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.792s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:47:19 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Deleted volume successfully. Jul 08 02:47:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-eb05372e-6b36-403d-8ad6-8a3b5ce0df7d tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "cinder-c8975ddc-3425-4dbc-9282-3f61199f148a-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:20 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-799244b1-9018-4782-a1b9-db4f1165a362 req-087fc58e-ce12-4bf9-b6f7-27f7f52e92ac tempest-AttachVolumeTestJSON-1302012325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23cf9222-edec-476b-a00d-eb0dbc7bde05" returned: 0 in 0.849s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-799244b1-9018-4782-a1b9-db4f1165a362 req-087fc58e-ce12-4bf9-b6f7-27f7f52e92ac tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.873s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-799244b1-9018-4782-a1b9-db4f1165a362 req-087fc58e-ce12-4bf9-b6f7-27f7f52e92ac tempest-AttachVolumeTestJSON-1302012325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-23cf9222-edec-476b-a00d-eb0dbc7bde05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45886b2f-7a8f-49db-a517-95a7edd01651', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:47:20 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-799244b1-9018-4782-a1b9-db4f1165a362 req-087fc58e-ce12-4bf9-b6f7-27f7f52e92ac tempest-AttachVolumeTestJSON-1302012325 None] attachment_update completed successfully. Jul 08 02:47:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Acquiring lock "cinder-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Lock "cinder-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Acquiring lock "cinder-quobyte-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1" acquired by "delete_volume" :: waited 0.012s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:21 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f3b344-f70a-4fa8-b68b-29012c3fc767]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:21 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1 Jul 08 02:47:21 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:21 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1" returned: 0 in 0.775s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:21 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1 Jul 08 02:47:21 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:22 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-476aa558-e759-4f01-a538-6d5b6ac27dfc req-e856aa39-1391-4559-b114-51c7279efeca tempest-TestInstancesWithCinderVolumes-1446990626 None] Terminate volume connection completed successfully. Jul 08 02:47:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-476aa558-e759-4f01-a538-6d5b6ac27dfc req-e856aa39-1391-4559-b114-51c7279efeca tempest-TestInstancesWithCinderVolumes-1446990626 None] Deleting attachment 22326e51-4ec3-45e1-a89e-9f6c17a12d6c. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:47:22 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1" returned: 0 in 0.675s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:22 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1" released by "delete_volume" :: held 1.488s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:22 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Created reservations ['3e5d02b7-930c-4313-9d0a-53c228131562', 'a0cd5341-7b77-4240-bf3b-44552fefa131', 'b4988aa9-8121-4edf-959b-d3c93e43fa61', '984be8f6-891e-45eb-909b-ad5099bb4eb5'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:47:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:47:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:47:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:22 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:47:22 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Acquiring lock "cinder-39c7a3a4-7231-4d53-8289-1a0d54b9e16b-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Lock "cinder-39c7a3a4-7231-4d53-8289-1a0d54b9e16b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:23 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.656s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:23 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:47:23 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Deleted volume successfully. Jul 08 02:47:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b765138-67f1-4f6e-ad17-e714600708be tempest-VolumesGetTest-942511531 None] Lock "cinder-aab79bc7-b2dc-4cc6-a2c6-9b0286769bb1-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Acquiring lock "cinder-quobyte-39c7a3a4-7231-4d53-8289-1a0d54b9e16b" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-39c7a3a4-7231-4d53-8289-1a0d54b9e16b" acquired by "delete_volume" :: waited 0.014s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:23 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[41989eaa-271e-4851-a7ee-5604ce461313]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:23 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b Jul 08 02:47:23 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "cinder-d4628bba-631b-42a7-a9a2-6399504a4703-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "cinder-d4628bba-631b-42a7-a9a2-6399504a4703-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "cinder-quobyte-d4628bba-631b-42a7-a9a2-6399504a4703" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "cinder-quobyte-d4628bba-631b-42a7-a9a2-6399504a4703" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:24 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a145a3-cf36-4eda-88b1-7b872f0de2aa]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d4628bba-631b-42a7-a9a2-6399504a4703 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:24 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b" returned: 0 in 0.894s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:24 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d4628bba-631b-42a7-a9a2-6399504a4703 Jul 08 02:47:24 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:24 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b Jul 08 02:47:24 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Flow 'volume_create_manager' (820542fa-27b3-4011-9784-4d1e98515528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e87eb8-d093-4fb0-9090-d723e171492b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e87eb8-d093-4fb0-9090-d723e171492b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1493718880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74728274-0b50-4fac-9cab-248cf75e0d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f1f3c8272a14b28b87f9be697b8e9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:47:25Z,use_quota=True,user_id='577c9c242a7c466eb4f0a2928c7313a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0139f51-55d9-45e8-a390-cff6d40f5ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0139f51-55d9-45e8-a390-cff6d40f5ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d1ad37-7433-47e8-a579-f1e3ee25248c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d1ad37-7433-47e8-a579-f1e3ee25248c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74728274-0b50-4fac-9cab-248cf75e0d88', 'volume_name': 'volume-74728274-0b50-4fac-9cab-248cf75e0d88', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc410c3-e6fd-435d-9190-cf6470522337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc410c3-e6fd-435d-9190-cf6470522337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26681d5a-29dc-43ba-ba4b-098569e4cdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:25 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Volume 74728274-0b50-4fac-9cab-248cf75e0d88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74728274-0b50-4fac-9cab-248cf75e0d88', 'volume_size': 1} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1493718880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74728274-0b50-4fac-9cab-248cf75e0d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f1f3c8272a14b28b87f9be697b8e9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:47:25Z,use_quota=True,user_id='577c9c242a7c466eb4f0a2928c7313a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Creating volume 74728274-0b50-4fac-9cab-248cf75e0d88 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:47:25 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-74728274-0b50-4fac-9cab-248cf75e0d88 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:25 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-74728274-0b50-4fac-9cab-248cf75e0d88 1073741824 Jul 08 02:47:25 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:25 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b" returned: 1 in 0.974s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:25 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d4628bba-631b-42a7-a9a2-6399504a4703" returned: 0 in 1.091s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d4628bba-631b-42a7-a9a2-6399504a4703 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:25 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b Jul 08 02:47:25 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:25 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d4628bba-631b-42a7-a9a2-6399504a4703 Jul 08 02:47:25 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:26 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-39c7a3a4-7231-4d53-8289-1a0d54b9e16b" returned: 0 in 0.863s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Lock "cinder-quobyte-39c7a3a4-7231-4d53-8289-1a0d54b9e16b" released by "delete_volume" :: held 2.813s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:26 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d4628bba-631b-42a7-a9a2-6399504a4703" returned: 0 in 0.954s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "cinder-quobyte-d4628bba-631b-42a7-a9a2-6399504a4703" released by "delete_volume" :: held 2.122s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Created reservations ['462d0bdb-6a72-40b8-8d8f-537cb0a38a1d', 'd78af383-f8f7-45de-9102-5e6ecf8d0e93', '9b3b06b7-4d22-40e5-8392-9a1bc0b114bc', '81dad0dc-a5a7-4796-b7ae-b0d4e53c4b14'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:47:26 devstack cinder-volume[87238]: WARNING cinder.quota [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1991837357-983481144 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1991837357-983481144, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:47:26 devstack cinder-volume[87238]: WARNING cinder.quota [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1991837357-983481144 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1991837357-983481144, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Created reservations ['e9e9d2fb-671a-4cab-83e9-56654c41fa5c', 'a5fdf6c6-ee10-475c-95f0-4e52ec2957d3', '2cb39fd5-af8d-4ab3-ad18-0399b0128a8f', '4b0f0aa3-dfd4-466c-ae8e-cc9619847d92'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:47:26 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-74728274-0b50-4fac-9cab-248cf75e0d88 1073741824" returned: 0 in 1.229s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-74728274-0b50-4fac-9cab-248cf75e0d88 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:26 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:47:26 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:26 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-74728274-0b50-4fac-9cab-248cf75e0d88 Jul 08 02:47:26 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:26 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:47:26 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:27 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.104s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:27 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:47:27 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Deleted volume successfully. Jul 08 02:47:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ff9c0d6e-0aaa-4cb2-aca7-f7e78de563a4 tempest-VolumesGetTest-942511531 None] Lock "cinder-39c7a3a4-7231-4d53-8289-1a0d54b9e16b-delete_volume" released by "delete_volume" :: held 4.293s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:27 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-74728274-0b50-4fac-9cab-248cf75e0d88" returned: 0 in 1.202s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] <== create_volume: return (2533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:47:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.535s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26681d5a-29dc-43ba-ba4b-098569e4cdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74728274-0b50-4fac-9cab-248cf75e0d88', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:27 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab872523-8fde-4f38-8468-8703997dc09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.179s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:27 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:47:27 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Deleted volume successfully. Jul 08 02:47:27 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Volume volume-74728274-0b50-4fac-9cab-248cf75e0d88 (74728274-0b50-4fac-9cab-248cf75e0d88): created successfully Jul 08 02:47:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab872523-8fde-4f38-8468-8703997dc09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Flow 'volume_create_manager' (820542fa-27b3-4011-9784-4d1e98515528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:47:27 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-cf3cde91-e97d-4267-abe8-1171bff7644e tempest-AttachVolumeTestJSON-1302012325 None] Created volume successfully. Jul 08 02:47:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-98966167-e68e-4954-b533-e7f35ee8b0b9 tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "cinder-d4628bba-631b-42a7-a9a2-6399504a4703-delete_volume" released by "delete_volume" :: held 3.753s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Flow 'volume_create_manager' (3f0116d0-0a1b-4119-81c9-e746f5feca3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3144aa8c-ae98-4c1a-adb9-8c011f0de8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3144aa8c-ae98-4c1a-adb9-8c011f0de8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-511191479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57fb678-960e-4f06-9937-6b7ac48b40b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b1d29fbdd6842c8a5f7129b6105a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:47:30Z,use_quota=True,user_id='0f1cfaef6fae4d6c8627753967f085e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0468866-3ff6-460f-828d-be45cdae71ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0468866-3ff6-460f-828d-be45cdae71ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9802fa5c-63a6-4cc8-b3f9-1b612d0670c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9802fa5c-63a6-4cc8-b3f9-1b612d0670c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b57fb678-960e-4f06-9937-6b7ac48b40b0', 'volume_name': 'volume-b57fb678-960e-4f06-9937-6b7ac48b40b0', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c47220c-8ecd-4592-919f-2580c4ab93f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c47220c-8ecd-4592-919f-2580c4ab93f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc75fd39-62c8-4d3e-a281-6cec77ebe090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:30 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Volume b57fb678-960e-4f06-9937-6b7ac48b40b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b57fb678-960e-4f06-9937-6b7ac48b40b0', 'volume_size': 1} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-511191479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57fb678-960e-4f06-9937-6b7ac48b40b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b1d29fbdd6842c8a5f7129b6105a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:47:30Z,use_quota=True,user_id='0f1cfaef6fae4d6c8627753967f085e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Creating volume b57fb678-960e-4f06-9937-6b7ac48b40b0 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:47:30 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:47:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b57fb678-960e-4f06-9937-6b7ac48b40b0 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:30 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b57fb678-960e-4f06-9937-6b7ac48b40b0 1073741824 Jul 08 02:47:30 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-71376ed7-b087-482d-aac6-0fc37b05a61e req-1894c8e7-c338-47b6-961b-19b44ae6f18f tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:31 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b57fb678-960e-4f06-9937-6b7ac48b40b0 1073741824" returned: 0 in 0.948s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b57fb678-960e-4f06-9937-6b7ac48b40b0 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:31 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b57fb678-960e-4f06-9937-6b7ac48b40b0 Jul 08 02:47:31 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:32 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-e4285bf6-82b5-4bd7-8056-aa4d2507543b req-03b00f37-3dd4-49d0-9369-0182ae00f9d5 tempest-TestInstancesWithCinderVolumes-1446990626 None] Terminate volume connection completed successfully. Jul 08 02:47:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-e4285bf6-82b5-4bd7-8056-aa4d2507543b req-03b00f37-3dd4-49d0-9369-0182ae00f9d5 tempest-TestInstancesWithCinderVolumes-1446990626 None] Deleting attachment 88b9c15d-3ebc-4b85-ad80-fc8f42ee1b01. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:47:32 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b57fb678-960e-4f06-9937-6b7ac48b40b0" returned: 0 in 0.641s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:47:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-71376ed7-b087-482d-aac6-0fc37b05a61e req-1894c8e7-c338-47b6-961b-19b44ae6f18f tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.737s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc75fd39-62c8-4d3e-a281-6cec77ebe090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b57fb678-960e-4f06-9937-6b7ac48b40b0', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd988e94-05f0-42de-9ff2-c7c6966b2007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:47:32 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[83386d45-c5dc-477d-b151-a965fd03d83d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-71376ed7-b087-482d-aac6-0fc37b05a61e req-1894c8e7-c338-47b6-961b-19b44ae6f18f tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-74728274-0b50-4fac-9cab-248cf75e0d88 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:32 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Volume volume-b57fb678-960e-4f06-9937-6b7ac48b40b0 (b57fb678-960e-4f06-9937-6b7ac48b40b0): created successfully Jul 08 02:47:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd988e94-05f0-42de-9ff2-c7c6966b2007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:47:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Flow 'volume_create_manager' (3f0116d0-0a1b-4119-81c9-e746f5feca3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:47:32 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-26deb236-ade9-43a4-9af9-1a67c36355e7 tempest-VolumesNegativeTest-1386352272 None] Created volume successfully. Jul 08 02:47:32 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-74728274-0b50-4fac-9cab-248cf75e0d88 Jul 08 02:47:32 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:33 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-71376ed7-b087-482d-aac6-0fc37b05a61e req-1894c8e7-c338-47b6-961b-19b44ae6f18f tempest-AttachVolumeTestJSON-1302012325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-74728274-0b50-4fac-9cab-248cf75e0d88" returned: 0 in 0.825s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-71376ed7-b087-482d-aac6-0fc37b05a61e req-1894c8e7-c338-47b6-961b-19b44ae6f18f tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.849s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-71376ed7-b087-482d-aac6-0fc37b05a61e req-1894c8e7-c338-47b6-961b-19b44ae6f18f tempest-AttachVolumeTestJSON-1302012325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-74728274-0b50-4fac-9cab-248cf75e0d88', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ebdefa7-a425-4114-ae50-716391f49bb3', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:47:33 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-71376ed7-b087-482d-aac6-0fc37b05a61e req-1894c8e7-c338-47b6-961b-19b44ae6f18f tempest-AttachVolumeTestJSON-1302012325 None] attachment_update completed successfully. Jul 08 02:47:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "cinder-ff3f49df-60f7-4187-8425-0f1410f51698-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "cinder-ff3f49df-60f7-4187-8425-0f1410f51698-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "cinder-quobyte-ff3f49df-60f7-4187-8425-0f1410f51698" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "cinder-quobyte-ff3f49df-60f7-4187-8425-0f1410f51698" acquired by "delete_volume" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:35 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6c1141-b733-4cc7-b0ad-02b695efef02]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:35 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 Jul 08 02:47:35 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:36 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698" returned: 0 in 0.777s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:36 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 Jul 08 02:47:36 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:36 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698" returned: 1 in 0.770s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:47:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:36 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698 Jul 08 02:47:36 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:37 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff3f49df-60f7-4187-8425-0f1410f51698" returned: 0 in 0.631s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "cinder-quobyte-ff3f49df-60f7-4187-8425-0f1410f51698" released by "delete_volume" :: held 2.243s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:37 devstack cinder-volume[87238]: WARNING cinder.quota [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2067293985-10467062 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2067293985-10467062, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:47:37 devstack cinder-volume[87238]: WARNING cinder.quota [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2067293985-10467062 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2067293985-10467062, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:47:37 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Created reservations ['5bfb2fb6-abc1-4d7e-a9bf-16894340ac65', 'bd64029f-c81e-47cd-8849-59bc50257592', '495d6e43-295a-4305-9493-f8a2a7825050', '19f49630-610d-4647-a0a3-cc89ced758b7'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:47:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:47:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:47:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:37 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:47:37 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:38 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.692s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:38 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:47:38 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Deleted volume successfully. Jul 08 02:47:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-11f9cd79-e142-4b4e-b109-35f02d74e94f tempest-TestInstancesWithCinderVolumes-1446990626 None] Lock "cinder-ff3f49df-60f7-4187-8425-0f1410f51698-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:38 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-0187bb55-edf7-47d8-9bed-9338c361a614 req-ce6ec404-aaa4-43c8-aa4b-5d90054dfd77 tempest-AttachVolumeTestJSON-1302012325 None] Terminate volume connection completed successfully. Jul 08 02:47:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-0187bb55-edf7-47d8-9bed-9338c361a614 req-ce6ec404-aaa4-43c8-aa4b-5d90054dfd77 tempest-AttachVolumeTestJSON-1302012325 None] Deleting attachment 45886b2f-7a8f-49db-a517-95a7edd01651. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:47:41 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-63512b60-129e-4958-a4c0-747a1fa9159f req-bc8a8cb2-ad42-4cc4-9f81-d9b29f02f45d tempest-AttachVolumeTestJSON-1302012325 None] Terminate volume connection completed successfully. Jul 08 02:47:41 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-63512b60-129e-4958-a4c0-747a1fa9159f req-bc8a8cb2-ad42-4cc4-9f81-d9b29f02f45d tempest-AttachVolumeTestJSON-1302012325 None] Deleting attachment 6ebdefa7-a425-4114-ae50-716391f49bb3. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:47:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:47:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:47:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:47:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:47 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:47:47 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:48 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.356s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:47:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:47:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:47:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:47:51 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=99,cinder:SELECT=85,cinder:INSERT=26,cinder:DELETE=8 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:47:51 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=87,cinder:SELECT=90,cinder:INSERT=26,cinder:DELETE=7 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:47:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "cinder-74728274-0b50-4fac-9cab-248cf75e0d88-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Lock "cinder-74728274-0b50-4fac-9cab-248cf75e0d88-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "cinder-quobyte-74728274-0b50-4fac-9cab-248cf75e0d88" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Lock "cinder-quobyte-74728274-0b50-4fac-9cab-248cf75e0d88" acquired by "delete_volume" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:53 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c569b8-0ea3-48b5-ad55-804a7b33c4bb]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-74728274-0b50-4fac-9cab-248cf75e0d88 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:53 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-74728274-0b50-4fac-9cab-248cf75e0d88 Jul 08 02:47:53 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:54 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-74728274-0b50-4fac-9cab-248cf75e0d88" returned: 0 in 0.882s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-74728274-0b50-4fac-9cab-248cf75e0d88 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:54 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-74728274-0b50-4fac-9cab-248cf75e0d88 Jul 08 02:47:54 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:54 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-74728274-0b50-4fac-9cab-248cf75e0d88" returned: 0 in 0.636s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Lock "cinder-quobyte-74728274-0b50-4fac-9cab-248cf75e0d88" released by "delete_volume" :: held 1.586s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:54 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Created reservations ['a7f00ec1-6d58-4cf2-9362-36e3a27c14e2', '0d5df52c-e608-4e49-89f5-e7f46fa2bf87', 'c1bea30d-2a6d-42af-8d5c-b4bb3f921a12', 'f32c75d3-2f64-42c8-810c-b4af5ee4695b'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:47:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:54 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:47:54 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:47:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:54 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:47:54 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "cinder-23cf9222-edec-476b-a00d-eb0dbc7bde05-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Lock "cinder-23cf9222-edec-476b-a00d-eb0dbc7bde05-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "cinder-quobyte-23cf9222-edec-476b-a00d-eb0dbc7bde05" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Lock "cinder-quobyte-23cf9222-edec-476b-a00d-eb0dbc7bde05" acquired by "delete_volume" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:55 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fc38a9-5395-45ef-8a6b-dda5efe3da5d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23cf9222-edec-476b-a00d-eb0dbc7bde05 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:55 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23cf9222-edec-476b-a00d-eb0dbc7bde05 Jul 08 02:47:55 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:55 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.752s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:55 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:47:55 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Deleted volume successfully. Jul 08 02:47:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-04948866-de5f-447a-8754-82c50aa57371 tempest-AttachVolumeTestJSON-1302012325 None] Lock "cinder-74728274-0b50-4fac-9cab-248cf75e0d88-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:56 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23cf9222-edec-476b-a00d-eb0dbc7bde05" returned: 0 in 0.829s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23cf9222-edec-476b-a00d-eb0dbc7bde05 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:56 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23cf9222-edec-476b-a00d-eb0dbc7bde05 Jul 08 02:47:56 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:56 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23cf9222-edec-476b-a00d-eb0dbc7bde05" returned: 0 in 0.683s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Lock "cinder-quobyte-23cf9222-edec-476b-a00d-eb0dbc7bde05" released by "delete_volume" :: held 1.566s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:57 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Created reservations ['3efab10c-eb38-4750-9873-f541a1da3fd7', '995d59cb-8374-4310-827a-171e80af782e', '82779fc8-20d2-4296-8782-e92885320a62', '1ba5d32c-21c1-4f35-a303-5bc58dfe4652'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:47:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:57 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:47:57 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:47:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:57 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:47:57 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "cinder-89f0358b-cfee-4111-8ff1-fc4bb4c0db78-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Lock "cinder-89f0358b-cfee-4111-8ff1-fc4bb4c0db78-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "cinder-quobyte-89f0358b-cfee-4111-8ff1-fc4bb4c0db78" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:47:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Lock "cinder-quobyte-89f0358b-cfee-4111-8ff1-fc4bb4c0db78" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:47:57 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[05355e5d-4f71-479b-92fd-20a0f8fd53a7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:47:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:57 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78 Jul 08 02:47:57 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:58 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.817s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:58 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:47:58 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Deleted volume successfully. Jul 08 02:47:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6b3b39a5-0fc3-4b1c-93c6-6a25541d7e4f tempest-AttachVolumeTestJSON-1302012325 None] Lock "cinder-23cf9222-edec-476b-a00d-eb0dbc7bde05-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:58 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78" returned: 0 in 0.896s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:58 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78 Jul 08 02:47:58 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:47:59 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Jul 08 02:47:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89f0358b-cfee-4111-8ff1-fc4bb4c0db78" returned: 0 in 0.931s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:47:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Lock "cinder-quobyte-89f0358b-cfee-4111-8ff1-fc4bb4c0db78" released by "delete_volume" :: held 1.895s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:47:59 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Created reservations ['c4545e38-f7de-44ca-bb02-f502030ab9cb', '70820636-5536-444d-92ca-9dac4577c7c5', 'a3a8c513-7061-4fec-8409-0d833f347512', 'd47a82a9-ae41-4a62-97a1-048f6946b9cf'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:47:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:47:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:47:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:47:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:47:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:47:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:47:59 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:47:59 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:00 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.882s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:00 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:48:00 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Deleted volume successfully. Jul 08 02:48:00 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e9e1a836-ad9e-4049-9aad-ab5d84d7b1af tempest-AttachVolumeTestJSON-1302012325 None] Lock "cinder-89f0358b-cfee-4111-8ff1-fc4bb4c0db78-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Acquiring lock "cinder-b57fb678-960e-4f06-9937-6b7ac48b40b0-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Lock "cinder-b57fb678-960e-4f06-9937-6b7ac48b40b0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Acquiring lock "cinder-quobyte-b57fb678-960e-4f06-9937-6b7ac48b40b0" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Lock "cinder-quobyte-b57fb678-960e-4f06-9937-6b7ac48b40b0" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:06 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95d759a-41b9-475c-a9a0-3cba171d062c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b57fb678-960e-4f06-9937-6b7ac48b40b0 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:06 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b57fb678-960e-4f06-9937-6b7ac48b40b0 Jul 08 02:48:06 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:07 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b57fb678-960e-4f06-9937-6b7ac48b40b0" returned: 0 in 0.914s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b57fb678-960e-4f06-9937-6b7ac48b40b0 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:07 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b57fb678-960e-4f06-9937-6b7ac48b40b0 Jul 08 02:48:07 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:08 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b57fb678-960e-4f06-9937-6b7ac48b40b0" returned: 0 in 0.750s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Lock "cinder-quobyte-b57fb678-960e-4f06-9937-6b7ac48b40b0" released by "delete_volume" :: held 1.711s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Created reservations ['2e296097-1c7b-470e-8814-f64a29f30023', '59b54eca-128f-4324-9747-054406deae90', '560cc337-34b5-4711-b1af-3235c60160eb', '29ca6e43-184b-411d-8f83-5bbc1b4f8c9b'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:08 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:48:08 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Flow 'volume_create_manager' (dc2d712a-2ec7-4ff7-a71d-6e42e09b1589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2d0a72-be67-48da-a2c4-0dc2be4a4d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2d0a72-be67-48da-a2c4-0dc2be4a4d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1179091263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e1e198b-b4d2-49e9-a505-6c7779a91624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d161c6320ca441a0988ed487a36a768d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:48:08Z,use_quota=True,user_id='a9e309adf74f40ac9c994a36b0e20d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66c85ae-585b-4e1b-b3aa-27933b7edeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66c85ae-585b-4e1b-b3aa-27933b7edeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ebf26a0-b7d7-4761-9c9b-7d239a21cb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ebf26a0-b7d7-4761-9c9b-7d239a21cb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e1e198b-b4d2-49e9-a505-6c7779a91624', 'volume_name': 'volume-7e1e198b-b4d2-49e9-a505-6c7779a91624', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c230a68-c74f-49d5-ba11-ab0b837ee6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c230a68-c74f-49d5-ba11-ab0b837ee6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f464190a-081c-40a4-9ef2-d4cd62489e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:08 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Volume 7e1e198b-b4d2-49e9-a505-6c7779a91624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e1e198b-b4d2-49e9-a505-6c7779a91624', 'volume_size': 1} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1179091263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e1e198b-b4d2-49e9-a505-6c7779a91624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d161c6320ca441a0988ed487a36a768d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:48:08Z,use_quota=True,user_id='a9e309adf74f40ac9c994a36b0e20d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Creating volume 7e1e198b-b4d2-49e9-a505-6c7779a91624 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:48:08 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:48:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:08 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 1073741824 Jul 08 02:48:08 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:09 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.853s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:09 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:48:09 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Deleted volume successfully. Jul 08 02:48:09 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a87fa106-aa3e-4084-8866-d43462674d94 tempest-VolumesNegativeTest-1386352272 None] Lock "cinder-b57fb678-960e-4f06-9937-6b7ac48b40b0-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:09 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 1073741824" returned: 0 in 1.054s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:09 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 Jul 08 02:48:09 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:10 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624" returned: 0 in 0.858s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:48:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f464190a-081c-40a4-9ef2-d4cd62489e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e1e198b-b4d2-49e9-a505-6c7779a91624', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899ae208-32be-4356-9027-f9fa5227340a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:10 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Volume volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 (7e1e198b-b4d2-49e9-a505-6c7779a91624): created successfully Jul 08 02:48:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899ae208-32be-4356-9027-f9fa5227340a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Flow 'volume_create_manager' (dc2d712a-2ec7-4ff7-a71d-6e42e09b1589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:48:10 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-bd275b26-77dc-4cb1-ba70-e9616f2a6e63 req-faa6203b-ded7-45d9-9435-62203a5cfa87 tempest-VolumesSnapshotsTestJSON-274058131 None] Created volume successfully. Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Flow 'volume_create_manager' (898c5768-64d2-4f6b-b433-4f3c6660c6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ca6798-c08d-4c47-9f6a-c33870aa1e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ca6798-c08d-4c47-9f6a-c33870aa1e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1097267643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c514e725-6a23-446d-8e0f-1b27999b8742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69a0a85cf33a48a297ae9a50870bc98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:48:12Z,use_quota=True,user_id='31bd94ab9c154f8197168b3a630fc534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5d230f-334d-4bb8-af6b-1de03acbee0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5d230f-334d-4bb8-af6b-1de03acbee0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c478be2-b057-43e9-92e8-0ec8e7fc4463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c478be2-b057-43e9-92e8-0ec8e7fc4463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c514e725-6a23-446d-8e0f-1b27999b8742', 'volume_name': 'volume-c514e725-6a23-446d-8e0f-1b27999b8742', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6c945b-8b89-4011-a1bb-0f2436a9b109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6c945b-8b89-4011-a1bb-0f2436a9b109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7332350-bb1f-4682-9410-17bde207c629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:11 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Volume c514e725-6a23-446d-8e0f-1b27999b8742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c514e725-6a23-446d-8e0f-1b27999b8742', 'volume_size': 1} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1097267643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c514e725-6a23-446d-8e0f-1b27999b8742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69a0a85cf33a48a297ae9a50870bc98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:48:12Z,use_quota=True,user_id='31bd94ab9c154f8197168b3a630fc534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Creating volume c514e725-6a23-446d-8e0f-1b27999b8742 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:48:11 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:48:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:12 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742 1073741824 Jul 08 02:48:12 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:13 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742 1073741824" returned: 0 in 1.042s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:13 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742 Jul 08 02:48:13 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:13 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742" returned: 0 in 0.732s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:48:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.613s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] Creating offline snapshot 2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e of volume 7e1e198b-b4d2-49e9-a505-6c7779a91624 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:48:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7332350-bb1f-4682-9410-17bde207c629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c514e725-6a23-446d-8e0f-1b27999b8742', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7601461-5d94-47c9-a020-f98ea00de14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:13 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00537df-2948-4c7f-b901-71b788f6f3f1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:13 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Volume volume-c514e725-6a23-446d-8e0f-1b27999b8742 (c514e725-6a23-446d-8e0f-1b27999b8742): created successfully Jul 08 02:48:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7601461-5d94-47c9-a020-f98ea00de14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Flow 'volume_create_manager' (898c5768-64d2-4f6b-b433-4f3c6660c6d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:48:13 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-281639cf-dde6-4429-a9ba-3e60c2c41ac7 tempest-VolumesSnapshotListTestJSON-1938391726 None] Created volume successfully. Jul 08 02:48:13 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 Jul 08 02:48:13 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:14 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624" returned: 0 in 0.782s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:14 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e 1G Jul 08 02:48:14 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:15 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e 1G" returned: 0 in 0.851s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:15 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e Jul 08 02:48:15 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:16 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e" returned: 0 in 0.720s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:16 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e is being set with open permissions: ugo+rw Jul 08 02:48:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:16 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e Jul 08 02:48:16 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:16 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e" returned: 0 in 0.645s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:16 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.info Jul 08 02:48:16 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:17 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.info" returned: 0 in 0.666s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:17 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.info is being set with open permissions: ugo+rw Jul 08 02:48:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:17 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.info Jul 08 02:48:17 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:18 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.info" returned: 0 in 0.667s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.440s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.066s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] Creating offline snapshot b433880b-6643-431b-85b4-a9e2094ff3aa of volume c514e725-6a23-446d-8e0f-1b27999b8742 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:48:18 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-b6c1c5e4-6304-4b3c-9950-f58fb0732eed req-ae28aa01-e045-4a44-b931-5d61725c9768 tempest-VolumesSnapshotsTestJSON-274058131 None] Create snapshot completed successfully Jul 08 02:48:18 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[406fa6ad-4c50-40cd-89ac-082ed103a626]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:18 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742 Jul 08 02:48:18 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Acquiring lock "cinder-2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "cinder-2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Acquiring lock "cinder-quobyte-7e1e198b-b4d2-49e9-a505-6c7779a91624" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:19 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742" returned: 0 in 0.813s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "cinder-quobyte-7e1e198b-b4d2-49e9-a505-6c7779a91624" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Acquiring lock "cinder-quobyte-2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:19 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa 1G Jul 08 02:48:19 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "cinder-quobyte-2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Deleting offline snapshot 2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e of volume 7e1e198b-b4d2-49e9-a505-6c7779a91624 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:48:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] snapshot_file for this snap is: volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:48:19 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe7b401-4318-483d-bae8-e2d4dbf00244]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:19 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e Jul 08 02:48:19 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:19 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e" returned: 0 in 0.805s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e1e198b-b4d2-49e9-a505-6c7779a91624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:48:19 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa 1G" returned: 0 in 0.903s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c514e725-6a23-446d-8e0f-1b27999b8742 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:20 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca579fc8-a5a0-4987-8a86-e1801f153bb6]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:20 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c514e725-6a23-446d-8e0f-1b27999b8742 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa Jul 08 02:48:20 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:20 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 Jul 08 02:48:20 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:20 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c514e725-6a23-446d-8e0f-1b27999b8742 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa" returned: 0 in 0.692s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:20 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa is being set with open permissions: ugo+rw Jul 08 02:48:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:20 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa Jul 08 02:48:20 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:20 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624" returned: 0 in 0.814s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:20 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e Jul 08 02:48:20 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:21 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa" returned: 0 in 0.673s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:21 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.info Jul 08 02:48:21 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:21 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e" returned: 0 in 0.830s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:21 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e Jul 08 02:48:21 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:22 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.info" returned: 0 in 0.743s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:22 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.info is being set with open permissions: ugo+rw Jul 08 02:48:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:22 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.info Jul 08 02:48:22 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:22 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624.2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e" returned: 0 in 0.824s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:22 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "cinder-quobyte-2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e" released by "_delete_snapshot" :: held 3.413s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:22 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "cinder-quobyte-7e1e198b-b4d2-49e9-a505-6c7779a91624" released by "delete_snapshot" :: held 3.442s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:22 devstack cinder-volume[87238]: DEBUG cinder.quota [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Created reservations ['8cf39229-1748-471b-9e2a-39fce9baca34', '06a8de97-233e-484d-90e2-9166780b2cc5', '210be0ad-f5f1-4b9e-ad97-2abaae637966', '88be5f70-739f-459d-9af1-417fc1422bbf'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:48:22 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Delete snapshot completed successfully. Jul 08 02:48:22 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-5679cba8-fdc8-4152-bcc8-3fab6f7800fe req-5a85c639-cff8-4512-9d5d-2db1ba6b3e31 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "cinder-2ac6ab39-dcbf-4ac8-9ba6-77b7c82d984e-delete_snapshot" released by "delete_snapshot" :: held 3.606s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:22 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.info" returned: 0 in 0.829s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.759s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:23 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-673ae751-fdea-46bc-a2b3-1e9d7480dca9 tempest-VolumesSnapshotListTestJSON-1938391726 None] Create snapshot completed successfully Jul 08 02:48:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Acquiring lock "cinder-7e1e198b-b4d2-49e9-a505-6c7779a91624-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "cinder-7e1e198b-b4d2-49e9-a505-6c7779a91624-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Acquiring lock "cinder-quobyte-7e1e198b-b4d2-49e9-a505-6c7779a91624" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "cinder-quobyte-7e1e198b-b4d2-49e9-a505-6c7779a91624" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:23 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af68f48-5049-4ed9-825e-74f974b753df]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2404a984-66d3-4371-870b-38f0672ae2d4 tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2404a984-66d3-4371-870b-38f0672ae2d4 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2404a984-66d3-4371-870b-38f0672ae2d4 tempest-VolumesSnapshotListTestJSON-1938391726 None] Creating offline snapshot c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 of volume c514e725-6a23-446d-8e0f-1b27999b8742 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:48:23 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f582bbad-4297-4794-8088-8a526a26aeaa]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2404a984-66d3-4371-870b-38f0672ae2d4 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:23 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 Jul 08 02:48:23 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:24 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa Jul 08 02:48:24 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:24 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624" returned: 0 in 1.034s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:24 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624 Jul 08 02:48:24 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:24 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2404a984-66d3-4371-870b-38f0672ae2d4 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa" returned: 0 in 0.934s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2404a984-66d3-4371-870b-38f0672ae2d4 tempest-VolumesSnapshotListTestJSON-1938391726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c514e725-6a23-446d-8e0f-1b27999b8742(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:48:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2404a984-66d3-4371-870b-38f0672ae2d4 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:24 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 1G Jul 08 02:48:24 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:25 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7e1e198b-b4d2-49e9-a505-6c7779a91624" returned: 0 in 0.756s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "cinder-quobyte-7e1e198b-b4d2-49e9-a505-6c7779a91624" released by "delete_volume" :: held 1.894s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:25 devstack cinder-volume[87238]: DEBUG cinder.quota [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Created reservations ['893a9988-b277-4df6-9853-c450cac28252', '371c6371-a3dd-44d7-b289-d3005b4a5446', '4e26550a-67f0-4440-b42c-164a3dc92379', '24702da5-e4af-4577-800b-7354dbc509e0'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:48:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:48:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:48:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:25 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:48:25 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:25 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2404a984-66d3-4371-870b-38f0672ae2d4 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 1G" returned: 0 in 0.935s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2404a984-66d3-4371-870b-38f0672ae2d4 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:25 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 Jul 08 02:48:25 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:26 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.736s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:26 devstack cinder-volume[87238]: DEBUG cinder.manager [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:48:26 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Deleted volume successfully. Jul 08 02:48:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-23423d7b-7664-48a5-b56a-f6b6951be485 req-9d2c94cc-3be2-46c8-9a33-4916548112c9 tempest-VolumesSnapshotsTestJSON-274058131 None] Lock "cinder-7e1e198b-b4d2-49e9-a505-6c7779a91624-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:26 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2404a984-66d3-4371-870b-38f0672ae2d4 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29" returned: 0 in 0.772s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:26 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-2404a984-66d3-4371-870b-38f0672ae2d4 tempest-VolumesSnapshotListTestJSON-1938391726 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 is being set with open permissions: ugo+rw Jul 08 02:48:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2404a984-66d3-4371-870b-38f0672ae2d4 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:26 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 Jul 08 02:48:26 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:27 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2404a984-66d3-4371-870b-38f0672ae2d4 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29" returned: 0 in 0.759s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2404a984-66d3-4371-870b-38f0672ae2d4 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.534s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:27 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2404a984-66d3-4371-870b-38f0672ae2d4 tempest-VolumesSnapshotListTestJSON-1938391726 None] Create snapshot completed successfully Jul 08 02:48:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-fc0d542a-a4e4-4aee-9f93-7f2b33bc84ac tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-fc0d542a-a4e4-4aee-9f93-7f2b33bc84ac tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-fc0d542a-a4e4-4aee-9f93-7f2b33bc84ac tempest-VolumesSnapshotListTestJSON-1938391726 None] Creating offline snapshot ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 of volume c514e725-6a23-446d-8e0f-1b27999b8742 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:48:28 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[6800c662-6725-4a54-8312-d141d07c65be]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fc0d542a-a4e4-4aee-9f93-7f2b33bc84ac tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:28 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 Jul 08 02:48:28 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:29 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fc0d542a-a4e4-4aee-9f93-7f2b33bc84ac tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29" returned: 0 in 0.926s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-fc0d542a-a4e4-4aee-9f93-7f2b33bc84ac tempest-VolumesSnapshotListTestJSON-1938391726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c514e725-6a23-446d-8e0f-1b27999b8742(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:48:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fc0d542a-a4e4-4aee-9f93-7f2b33bc84ac tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:29 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 1G Jul 08 02:48:29 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:30 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fc0d542a-a4e4-4aee-9f93-7f2b33bc84ac tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 1G" returned: 0 in 0.941s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fc0d542a-a4e4-4aee-9f93-7f2b33bc84ac tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:30 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 Jul 08 02:48:30 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:31 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e5eeb0c4-47f8-46c6-aef7-ef5fe6b64e21 tempest-GroupsV320Test-319446283 None] Group tempest-GroupsV320Test-Group-1577390180: creating Jul 08 02:48:31 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fc0d542a-a4e4-4aee-9f93-7f2b33bc84ac tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524" returned: 0 in 0.956s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:31 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-fc0d542a-a4e4-4aee-9f93-7f2b33bc84ac tempest-VolumesSnapshotListTestJSON-1938391726 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 is being set with open permissions: ugo+rw Jul 08 02:48:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fc0d542a-a4e4-4aee-9f93-7f2b33bc84ac tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:31 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 Jul 08 02:48:31 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:31 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e5eeb0c4-47f8-46c6-aef7-ef5fe6b64e21 tempest-GroupsV320Test-319446283 None] Group tempest-GroupsV320Test-Group-1577390180: created successfully Jul 08 02:48:31 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e5eeb0c4-47f8-46c6-aef7-ef5fe6b64e21 tempest-GroupsV320Test-319446283 None] Create group completed successfully. Jul 08 02:48:31 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fc0d542a-a4e4-4aee-9f93-7f2b33bc84ac tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524" returned: 0 in 0.721s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-fc0d542a-a4e4-4aee-9f93-7f2b33bc84ac tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.659s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:32 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-fc0d542a-a4e4-4aee-9f93-7f2b33bc84ac tempest-VolumesSnapshotListTestJSON-1938391726 None] Create snapshot completed successfully Jul 08 02:48:32 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-194e5707-c5a6-41ce-88fb-e4cb74d5f699 tempest-GroupsV320Test-319446283 None] Created reservations ['d2d23994-a918-45d8-8771-7976726c8c62'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-194e5707-c5a6-41ce-88fb-e4cb74d5f699 tempest-GroupsV320Test-319446283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-194e5707-c5a6-41ce-88fb-e4cb74d5f699 tempest-GroupsV320Test-319446283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-194e5707-c5a6-41ce-88fb-e4cb74d5f699 tempest-GroupsV320Test-319446283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-194e5707-c5a6-41ce-88fb-e4cb74d5f699 tempest-GroupsV320Test-319446283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-194e5707-c5a6-41ce-88fb-e4cb74d5f699 tempest-GroupsV320Test-319446283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-194e5707-c5a6-41ce-88fb-e4cb74d5f699 tempest-GroupsV320Test-319446283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:33 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:48:33 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Flow 'volume_create_manager' (2b913f23-da90-4260-80ae-ece95240ffd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e704be76-6139-4b6e-8320-56bd2f2ce016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e704be76-6139-4b6e-8320-56bd2f2ce016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-183479874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00963b65-ba9e-4b4e-ac20-6c37fb4d0476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6a8ab32c1947db812209c8a886909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:48:34Z,use_quota=True,user_id='a5cda3ea2cc540aaadbcdc48a9fa7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63c2a55-1ee1-436b-af90-fb2624d5bd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63c2a55-1ee1-436b-af90-fb2624d5bd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c35d68-1dc1-4977-a9b4-594ad6d0b21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c35d68-1dc1-4977-a9b4-594ad6d0b21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00963b65-ba9e-4b4e-ac20-6c37fb4d0476', 'volume_name': 'volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ba6109-b1b8-4343-a86c-dc555a9fe790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ba6109-b1b8-4343-a86c-dc555a9fe790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d10ecac-25c4-45de-92f2-9b7521911b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:33 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Volume 00963b65-ba9e-4b4e-ac20-6c37fb4d0476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476', 'volume_size': 1} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-183479874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00963b65-ba9e-4b4e-ac20-6c37fb4d0476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6a8ab32c1947db812209c8a886909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:48:34Z,use_quota=True,user_id='a5cda3ea2cc540aaadbcdc48a9fa7d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Creating volume 00963b65-ba9e-4b4e-ac20-6c37fb4d0476 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:48:33 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:33 devstack sudo[98954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476 1073741824 Jul 08 02:48:33 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "cinder-ff7f7c5c-3bd8-4cc9-8620-6b3de2000524-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-ff7f7c5c-3bd8-4cc9-8620-6b3de2000524-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "cinder-quobyte-c514e725-6a23-446d-8e0f-1b27999b8742" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-quobyte-c514e725-6a23-446d-8e0f-1b27999b8742" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "cinder-quobyte-ff7f7c5c-3bd8-4cc9-8620-6b3de2000524" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-quobyte-ff7f7c5c-3bd8-4cc9-8620-6b3de2000524" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Deleting offline snapshot ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 of volume c514e725-6a23-446d-8e0f-1b27999b8742 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] snapshot_file for this snap is: volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e91c4ad-cb2f-4369-93c6-adbd61ee8b6e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:33 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-194e5707-c5a6-41ce-88fb-e4cb74d5f699 tempest-GroupsV320Test-319446283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.930s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:33 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-194e5707-c5a6-41ce-88fb-e4cb74d5f699 tempest-GroupsV320Test-319446283 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:48:34 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-194e5707-c5a6-41ce-88fb-e4cb74d5f699 tempest-GroupsV320Test-319446283 None] Delete group completed successfully. Jul 08 02:48:34 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 Jul 08 02:48:34 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:34 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476 1073741824" returned: 0 in 1.082s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:34 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476 Jul 08 02:48:34 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:35 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524" returned: 0 in 1.121s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c514e725-6a23-446d-8e0f-1b27999b8742(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:48:35 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f54ea10-118b-4a51-abf5-1de31e5b3b9e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:35 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 Jul 08 02:48:35 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:35 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476" returned: 0 in 0.814s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:48:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d10ecac-25c4-45de-92f2-9b7521911b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174ea248-81f7-4643-82ec-9ff1d60c1534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:35 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Volume volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476 (00963b65-ba9e-4b4e-ac20-6c37fb4d0476): created successfully Jul 08 02:48:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174ea248-81f7-4643-82ec-9ff1d60c1534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Flow 'volume_create_manager' (2b913f23-da90-4260-80ae-ece95240ffd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:48:35 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-8d047351-6c7b-472e-b275-82be8fb9c415 tempest-TestMinimumBasicScenario-277539432 None] Created volume successfully. Jul 08 02:48:36 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29" returned: 0 in 1.018s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:36 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c514e725-6a23-446d-8e0f-1b27999b8742(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:48:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:36 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 Jul 08 02:48:36 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524" returned: 0 in 1.090s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:37 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:37 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524 Jul 08 02:48:37 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:37 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.ff7f7c5c-3bd8-4cc9-8620-6b3de2000524" returned: 0 in 0.725s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-quobyte-ff7f7c5c-3bd8-4cc9-8620-6b3de2000524" released by "_delete_snapshot" :: held 4.089s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-quobyte-c514e725-6a23-446d-8e0f-1b27999b8742" released by "delete_snapshot" :: held 4.119s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:38 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Created reservations ['d9b8c04d-69a6-4bf9-8f97-59e471ba6b16', '10c6e253-53e3-4d1b-82d5-3d673f660030', '205a7d0c-c983-4061-8d59-d21e29f1cd65', '0fa5802b-a2e0-4b7e-9d01-09cf48ac5a54'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:48:38 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Delete snapshot completed successfully. Jul 08 02:48:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-68b9e5ae-f426-45a0-b057-ba4ed955a705 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-ff7f7c5c-3bd8-4cc9-8620-6b3de2000524-delete_snapshot" released by "delete_snapshot" :: held 4.288s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "cinder-c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "cinder-quobyte-c514e725-6a23-446d-8e0f-1b27999b8742" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-quobyte-c514e725-6a23-446d-8e0f-1b27999b8742" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "cinder-quobyte-c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-quobyte-c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Deleting offline snapshot c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 of volume c514e725-6a23-446d-8e0f-1b27999b8742 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:48:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] snapshot_file for this snap is: volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:48:39 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe151abc-b090-4e52-ab78-a860238f094f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:39 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 Jul 08 02:48:39 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-503fdcd1-c5ad-4fc3-9987-b59d2507ec18 req-6493717e-09e7-4ef7-8c2e-bb19c03c7c3e tempest-TestMinimumBasicScenario-277539432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-503fdcd1-c5ad-4fc3-9987-b59d2507ec18 req-6493717e-09e7-4ef7-8c2e-bb19c03c7c3e tempest-TestMinimumBasicScenario-277539432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:40 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[e284128c-c7bd-4f39-a9a8-8e5410727d60]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-503fdcd1-c5ad-4fc3-9987-b59d2507ec18 req-6493717e-09e7-4ef7-8c2e-bb19c03c7c3e tempest-TestMinimumBasicScenario-277539432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:40 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29" returned: 0 in 1.055s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:40 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c514e725-6a23-446d-8e0f-1b27999b8742(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:48:40 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8896ae-a5de-4bd8-add1-204c182882f9]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:40 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476 Jul 08 02:48:40 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:40 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa Jul 08 02:48:40 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:41 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-503fdcd1-c5ad-4fc3-9987-b59d2507ec18 req-6493717e-09e7-4ef7-8c2e-bb19c03c7c3e tempest-TestMinimumBasicScenario-277539432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476" returned: 0 in 0.945s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-503fdcd1-c5ad-4fc3-9987-b59d2507ec18 req-6493717e-09e7-4ef7-8c2e-bb19c03c7c3e tempest-TestMinimumBasicScenario-277539432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.971s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:41 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-503fdcd1-c5ad-4fc3-9987-b59d2507ec18 req-6493717e-09e7-4ef7-8c2e-bb19c03c7c3e tempest-TestMinimumBasicScenario-277539432 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96e0389d-c8db-42e4-9d79-2450e8e5e104', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:48:41 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa" returned: 0 in 1.014s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c514e725-6a23-446d-8e0f-1b27999b8742(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:48:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:41 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-503fdcd1-c5ad-4fc3-9987-b59d2507ec18 req-6493717e-09e7-4ef7-8c2e-bb19c03c7c3e tempest-TestMinimumBasicScenario-277539432 None] attachment_update completed successfully. Jul 08 02:48:41 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 Jul 08 02:48:41 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:42 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29" returned: 0 in 0.923s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:42 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29 Jul 08 02:48:42 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:43 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29" returned: 0 in 0.728s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-quobyte-c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29" released by "_delete_snapshot" :: held 3.853s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-quobyte-c514e725-6a23-446d-8e0f-1b27999b8742" released by "delete_snapshot" :: held 3.898s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Created reservations ['d3495c4d-7311-470c-9488-6a8b2d7cb00b', '9be335ea-6a6b-410a-8f87-8f2c8dafa9df', '83d291f5-11cc-4ff7-9d1b-19b3514a8716', 'f23ad91d-756d-4818-985c-f2f7420c2e09'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:48:43 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Delete snapshot completed successfully. Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Flow 'volume_create_manager' (7ce5dc3e-a112-42f9-ba7f-2b2a31a96449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd3ff31-65a0-4e46-ba3b-06068438ac6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-703d6a98-5f60-453f-814b-aaed332d5b53 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-c88f33a9-1dbb-4dce-b4fc-5f56ad24ac29-delete_snapshot" released by "delete_snapshot" :: held 4.092s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd3ff31-65a0-4e46-ba3b-06068438ac6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-520814684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d9d72f-c83c-4fce-821d-21c633a032f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49fe4a3a3e7455ebbbd3e514e61600e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:48:43Z,use_quota=True,user_id='0852d306b27f4ac9855e7302372206bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017ab13c-331d-494f-8193-42c734b76aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017ab13c-331d-494f-8193-42c734b76aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc56986a-8a73-447e-a00a-1786dd258864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc56986a-8a73-447e-a00a-1786dd258864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0d9d72f-c83c-4fce-821d-21c633a032f1', 'volume_name': 'volume-f0d9d72f-c83c-4fce-821d-21c633a032f1', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5a6218-7996-40e5-947a-e7c770d378ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5a6218-7996-40e5-947a-e7c770d378ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d718f4-ab58-41ab-9d3a-cfbb4639bfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:43 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Volume f0d9d72f-c83c-4fce-821d-21c633a032f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0d9d72f-c83c-4fce-821d-21c633a032f1', 'volume_size': 1} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-520814684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d9d72f-c83c-4fce-821d-21c633a032f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49fe4a3a3e7455ebbbd3e514e61600e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:48:43Z,use_quota=True,user_id='0852d306b27f4ac9855e7302372206bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Creating volume f0d9d72f-c83c-4fce-821d-21c633a032f1 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:48:43 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f0d9d72f-c83c-4fce-821d-21c633a032f1 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:43 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f0d9d72f-c83c-4fce-821d-21c633a032f1 1073741824 Jul 08 02:48:43 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "cinder-b433880b-6643-431b-85b4-a9e2094ff3aa-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-b433880b-6643-431b-85b4-a9e2094ff3aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "cinder-quobyte-c514e725-6a23-446d-8e0f-1b27999b8742" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-quobyte-c514e725-6a23-446d-8e0f-1b27999b8742" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "cinder-quobyte-b433880b-6643-431b-85b4-a9e2094ff3aa" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-quobyte-b433880b-6643-431b-85b4-a9e2094ff3aa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Deleting offline snapshot b433880b-6643-431b-85b4-a9e2094ff3aa of volume c514e725-6a23-446d-8e0f-1b27999b8742 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] snapshot_file for this snap is: volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cabbd8-96ec-4060-bdac-7f6b93e3af1b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:43 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa Jul 08 02:48:43 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:44 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f0d9d72f-c83c-4fce-821d-21c633a032f1 1073741824" returned: 0 in 0.904s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f0d9d72f-c83c-4fce-821d-21c633a032f1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:44 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f0d9d72f-c83c-4fce-821d-21c633a032f1 Jul 08 02:48:44 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:44 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa" returned: 0 in 0.828s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:44 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c514e725-6a23-446d-8e0f-1b27999b8742(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:48:44 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca6b596-7869-46dc-b82a-f91bbe6b592a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:44 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742 Jul 08 02:48:44 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:44 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f0d9d72f-c83c-4fce-821d-21c633a032f1" returned: 0 in 0.681s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:44 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:48:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d718f4-ab58-41ab-9d3a-cfbb4639bfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d9d72f-c83c-4fce-821d-21c633a032f1', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57117c0a-c753-42e6-9e06-f1118418d542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:44 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Volume volume-f0d9d72f-c83c-4fce-821d-21c633a032f1 (f0d9d72f-c83c-4fce-821d-21c633a032f1): created successfully Jul 08 02:48:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57117c0a-c753-42e6-9e06-f1118418d542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Flow 'volume_create_manager' (7ce5dc3e-a112-42f9-ba7f-2b2a31a96449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:48:45 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-25962929-5bf1-4860-ac84-0142f12868e8 tempest-AbsoluteLimitsTests-1478355033 None] Created volume successfully. Jul 08 02:48:45 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742" returned: 0 in 0.799s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:45 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa Jul 08 02:48:45 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Acquiring lock "cinder-f0d9d72f-c83c-4fce-821d-21c633a032f1-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Lock "cinder-f0d9d72f-c83c-4fce-821d-21c633a032f1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Acquiring lock "cinder-quobyte-f0d9d72f-c83c-4fce-821d-21c633a032f1" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Lock "cinder-quobyte-f0d9d72f-c83c-4fce-821d-21c633a032f1" acquired by "delete_volume" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:45 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55c5c6b-433b-461b-9c03-deabfcd86871]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f0d9d72f-c83c-4fce-821d-21c633a032f1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:45 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f0d9d72f-c83c-4fce-821d-21c633a032f1 Jul 08 02:48:45 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:45 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa" returned: 0 in 0.766s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:45 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa Jul 08 02:48:45 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:46 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f0d9d72f-c83c-4fce-821d-21c633a032f1" returned: 0 in 0.805s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f0d9d72f-c83c-4fce-821d-21c633a032f1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:46 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f0d9d72f-c83c-4fce-821d-21c633a032f1 Jul 08 02:48:46 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:46 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742.b433880b-6643-431b-85b4-a9e2094ff3aa" returned: 0 in 0.666s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-quobyte-b433880b-6643-431b-85b4-a9e2094ff3aa" released by "_delete_snapshot" :: held 3.181s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-quobyte-c514e725-6a23-446d-8e0f-1b27999b8742" released by "delete_snapshot" :: held 3.204s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:46 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Created reservations ['31fdd9e9-29f2-40b7-bad3-74d2f60f72b3', 'ab8c8257-23aa-490c-b228-83d8643f8b29', '88484942-ffea-4670-8ee0-e77c315435db', 'a41e1aa2-86df-4bf7-a097-ad5f3c7a4162'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:48:46 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Delete snapshot completed successfully. Jul 08 02:48:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d5ad6834-547e-436b-b19d-e98d1cc50b86 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-b433880b-6643-431b-85b4-a9e2094ff3aa-delete_snapshot" released by "delete_snapshot" :: held 3.355s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:47 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f0d9d72f-c83c-4fce-821d-21c633a032f1" returned: 0 in 0.729s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Lock "cinder-quobyte-f0d9d72f-c83c-4fce-821d-21c633a032f1" released by "delete_volume" :: held 1.582s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Created reservations ['0f8e7b38-ebb3-4f04-96cd-7fc350b8cb14', '366eac51-1d0e-4ca3-89c9-ec8b97c402bf', 'd581e1ea-e1a5-48dd-957b-bcb57fb6ea38', '634b3aec-c05e-47b1-ba54-cfe95ca06d17'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:47 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:48:47 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:47 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:48:47 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "cinder-c514e725-6a23-446d-8e0f-1b27999b8742-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-c514e725-6a23-446d-8e0f-1b27999b8742-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "cinder-quobyte-c514e725-6a23-446d-8e0f-1b27999b8742" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-quobyte-c514e725-6a23-446d-8e0f-1b27999b8742" acquired by "delete_volume" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43dbf9c-3c51-4167-94e5-6c1aba15b125]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:48 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.820s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:48:48 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Deleted volume successfully. Jul 08 02:48:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14e90969-6eae-4f1b-9c8e-be99cb11e0d3 tempest-AbsoluteLimitsTests-1478355033 None] Lock "cinder-f0d9d72f-c83c-4fce-821d-21c633a032f1-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:48 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742 Jul 08 02:48:48 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:48 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.882s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:48:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:48:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:48:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:48:48 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742" returned: 0 in 0.875s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:48 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742 Jul 08 02:48:48 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:49 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c514e725-6a23-446d-8e0f-1b27999b8742" returned: 0 in 0.857s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-quobyte-c514e725-6a23-446d-8e0f-1b27999b8742" released by "delete_volume" :: held 1.836s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:49 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Created reservations ['44e49a95-9511-4670-95b5-b686d59c765e', '04253a39-ee26-4e89-a325-9616fc47ca92', '4e75ce6d-7dc8-49c6-b782-3ab7f468dcad', 'f091627e-2ae6-4bc4-a35f-2a6e7a4c6086'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:48:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:48:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:48:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:49 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:48:49 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:50 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.011s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:50 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:48:50 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Deleted volume successfully. Jul 08 02:48:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c6b0a869-9959-4d92-aec0-20adfb0e0fc8 tempest-VolumesSnapshotListTestJSON-1938391726 None] Lock "cinder-c514e725-6a23-446d-8e0f-1b27999b8742-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=100,cinder:SELECT=95,cinder:INSERT=26,cinder:DELETE=6 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=81,cinder:INSERT=25,cinder:UPDATE=102,cinder:DELETE=9 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Flow 'volume_create_manager' (f7987542-6773-497a-b305-974159d66b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403510c5-9a08-4847-a8b7-29d8ec9f36d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403510c5-9a08-4847-a8b7-29d8ec9f36d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-736622331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e0c4eb-724b-46ac-9841-f6577d2f447e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0658c23c202e470a83ee9f04a26cb033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:48:53Z,use_quota=True,user_id='80872ceb619c4bf5b892f51b1230da99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86510355-7658-498d-b868-af8d0932d4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86510355-7658-498d-b868-af8d0932d4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc7a2d6-32b6-4cfa-8cce-8e07695cb212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc7a2d6-32b6-4cfa-8cce-8e07695cb212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98e0c4eb-724b-46ac-9841-f6577d2f447e', 'volume_name': 'volume-98e0c4eb-724b-46ac-9841-f6577d2f447e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff08fef0-6539-4b63-9b0f-412716921f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff08fef0-6539-4b63-9b0f-412716921f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c2005c-2de9-41bd-ba66-83a56afc7d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:53 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Volume 98e0c4eb-724b-46ac-9841-f6577d2f447e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98e0c4eb-724b-46ac-9841-f6577d2f447e', 'volume_size': 1} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-736622331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e0c4eb-724b-46ac-9841-f6577d2f447e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0658c23c202e470a83ee9f04a26cb033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:48:53Z,use_quota=True,user_id='80872ceb619c4bf5b892f51b1230da99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Creating volume 98e0c4eb-724b-46ac-9841-f6577d2f447e {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:48:53 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:48:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:53 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e 1073741824 Jul 08 02:48:53 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:54 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e 1073741824" returned: 0 in 1.175s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:54 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e Jul 08 02:48:54 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:55 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e" returned: 0 in 0.712s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:48:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:48:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c2005c-2de9-41bd-ba66-83a56afc7d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98e0c4eb-724b-46ac-9841-f6577d2f447e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0eb8421-8b58-4ea5-911e-98574087e0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:48:55 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Volume volume-98e0c4eb-724b-46ac-9841-f6577d2f447e (98e0c4eb-724b-46ac-9841-f6577d2f447e): created successfully Jul 08 02:48:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0eb8421-8b58-4ea5-911e-98574087e0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:48:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Flow 'volume_create_manager' (f7987542-6773-497a-b305-974159d66b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:48:55 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-1f21e7b5-1f85-4faa-89f1-4870ea7afc84 tempest-VolumesDeleteCascade-1925987541 None] Created volume successfully. Jul 08 02:48:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:48:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:48:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] Creating offline snapshot 2e9918bf-16c1-4285-8eb8-8629682e877e of volume 98e0c4eb-724b-46ac-9841-f6577d2f447e {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:48:56 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ade294b-0ff3-4b0f-a59f-881e320f3a70]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:48:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:56 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e Jul 08 02:48:56 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:57 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e" returned: 0 in 0.810s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:57 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e 1G Jul 08 02:48:57 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:58 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e 1G" returned: 0 in 0.897s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e0c4eb-724b-46ac-9841-f6577d2f447e -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:58 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e0c4eb-724b-46ac-9841-f6577d2f447e -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e Jul 08 02:48:58 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:48:59 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 08 02:48:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e0c4eb-724b-46ac-9841-f6577d2f447e -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e" returned: 0 in 0.851s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:48:59 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e is being set with open permissions: ugo+rw Jul 08 02:48:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:48:59 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e Jul 08 02:48:59 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:00 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e" returned: 0 in 0.786s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:00 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.info Jul 08 02:49:00 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:01 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.info" returned: 0 in 0.845s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:01 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.info is being set with open permissions: ugo+rw Jul 08 02:49:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:01 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.info Jul 08 02:49:01 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:01 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.info" returned: 0 in 0.707s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:01 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-9099910e-60e2-40a5-a874-888730ea0723 tempest-VolumesDeleteCascade-1925987541 None] Create snapshot completed successfully Jul 08 02:49:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-db33e6ee-9d76-48e6-ae13-605d8db83ce7 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-db33e6ee-9d76-48e6-ae13-605d8db83ce7 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-db33e6ee-9d76-48e6-ae13-605d8db83ce7 tempest-VolumesDeleteCascade-1925987541 None] Creating offline snapshot d6fcafb3-5482-46ab-9bed-6e3031e12a18 of volume 98e0c4eb-724b-46ac-9841-f6577d2f447e {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:49:02 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5a0217-3728-4dc4-b854-6b9a2da57139]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db33e6ee-9d76-48e6-ae13-605d8db83ce7 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:02 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e Jul 08 02:49:02 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:03 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db33e6ee-9d76-48e6-ae13-605d8db83ce7 tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e" returned: 0 in 1.095s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-db33e6ee-9d76-48e6-ae13-605d8db83ce7 tempest-VolumesDeleteCascade-1925987541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e0c4eb-724b-46ac-9841-f6577d2f447e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:49:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db33e6ee-9d76-48e6-ae13-605d8db83ce7 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:03 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 1G Jul 08 02:49:03 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:04 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db33e6ee-9d76-48e6-ae13-605d8db83ce7 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 1G" returned: 0 in 1.153s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db33e6ee-9d76-48e6-ae13-605d8db83ce7 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:04 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 Jul 08 02:49:04 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:05 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db33e6ee-9d76-48e6-ae13-605d8db83ce7 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18" returned: 0 in 0.886s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:05 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-db33e6ee-9d76-48e6-ae13-605d8db83ce7 tempest-VolumesDeleteCascade-1925987541 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 is being set with open permissions: ugo+rw Jul 08 02:49:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db33e6ee-9d76-48e6-ae13-605d8db83ce7 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:05 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 Jul 08 02:49:05 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:06 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db33e6ee-9d76-48e6-ae13-605d8db83ce7 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18" returned: 0 in 0.688s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-db33e6ee-9d76-48e6-ae13-605d8db83ce7 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.966s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:06 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-db33e6ee-9d76-48e6-ae13-605d8db83ce7 tempest-VolumesDeleteCascade-1925987541 None] Create snapshot completed successfully Jul 08 02:49:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-98e0c4eb-724b-46ac-9841-f6577d2f447e-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-98e0c4eb-724b-46ac-9841-f6577d2f447e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Performing cascade delete. {{(pid=87238) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 02:49:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-2e9918bf-16c1-4285-8eb8-8629682e877e-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-2e9918bf-16c1-4285-8eb8-8629682e877e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-quobyte-98e0c4eb-724b-46ac-9841-f6577d2f447e" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-98e0c4eb-724b-46ac-9841-f6577d2f447e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-quobyte-2e9918bf-16c1-4285-8eb8-8629682e877e" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-2e9918bf-16c1-4285-8eb8-8629682e877e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Deleting offline snapshot 2e9918bf-16c1-4285-8eb8-8629682e877e of volume 98e0c4eb-724b-46ac-9841-f6577d2f447e {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:49:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] snapshot_file for this snap is: volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:49:06 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ea78cd-f9d3-41eb-b42b-5f2549bb9045]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:06 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e Jul 08 02:49:06 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:07 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e" returned: 0 in 0.864s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e0c4eb-724b-46ac-9841-f6577d2f447e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:49:07 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ff7143-ca67-4b58-81c9-33cfabac454b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:07 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e Jul 08 02:49:07 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:08 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e" returned: 0 in 0.847s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:08 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdd110b-c228-48a9-a658-04751e236a34]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:08 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 Jul 08 02:49:08 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:09 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18" returned: 0 in 1.315s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e0c4eb-724b-46ac-9841-f6577d2f447e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:49:09 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6b376a-5d0a-43da-9833-170ba75a10e1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:10 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e Jul 08 02:49:10 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:10 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e" returned: 0 in 0.857s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e0c4eb-724b-46ac-9841-f6577d2f447e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:49:10 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[d138451f-46e3-45c2-8745-3d7b96b7ea38]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:11 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e Jul 08 02:49:11 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:11 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e" returned: 0 in 0.981s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:11 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e Jul 08 02:49:11 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:12 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e" returned: 0 in 0.936s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:12 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e Jul 08 02:49:12 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:13 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.2e9918bf-16c1-4285-8eb8-8629682e877e" returned: 0 in 0.725s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e0c4eb-724b-46ac-9841-f6577d2f447e /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 -F qcow2 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:13 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e0c4eb-724b-46ac-9841-f6577d2f447e /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 -F qcow2 Jul 08 02:49:13 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:14 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e0c4eb-724b-46ac-9841-f6577d2f447e /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 -F qcow2" returned: 0 in 0.791s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-2e9918bf-16c1-4285-8eb8-8629682e877e" released by "_delete_snapshot" :: held 7.528s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-98e0c4eb-724b-46ac-9841-f6577d2f447e" released by "delete_snapshot" :: held 7.560s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:14 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Created reservations ['edeacb12-04a4-46d2-a696-35be5414ebc3', '4ed6f941-08cf-4718-9a2e-c5c2c87e6323', 'fecdecc5-ed24-469e-8218-e1b97c29104c', 'fe7fb1b6-f66f-440d-a9dd-dba7314a5913'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:49:14 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Delete snapshot completed successfully. Jul 08 02:49:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-2e9918bf-16c1-4285-8eb8-8629682e877e-delete_snapshot" released by "delete_snapshot" :: held 7.765s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-d6fcafb3-5482-46ab-9bed-6e3031e12a18-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-d6fcafb3-5482-46ab-9bed-6e3031e12a18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-quobyte-98e0c4eb-724b-46ac-9841-f6577d2f447e" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-98e0c4eb-724b-46ac-9841-f6577d2f447e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-quobyte-d6fcafb3-5482-46ab-9bed-6e3031e12a18" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-d6fcafb3-5482-46ab-9bed-6e3031e12a18" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Deleting offline snapshot d6fcafb3-5482-46ab-9bed-6e3031e12a18 of volume 98e0c4eb-724b-46ac-9841-f6577d2f447e {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:49:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] snapshot_file for this snap is: volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:49:14 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[668c1f5e-b5f9-4de2-80b2-825a7ea99b53]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:14 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 Jul 08 02:49:14 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:15 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18" returned: 0 in 0.883s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e0c4eb-724b-46ac-9841-f6577d2f447e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:49:15 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e580e16-abde-43d2-892e-f5048b14b015]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:15 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e Jul 08 02:49:15 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:16 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e" returned: 0 in 0.915s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:16 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 Jul 08 02:49:16 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:17 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18" returned: 0 in 0.776s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:17 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18 Jul 08 02:49:17 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Flow 'volume_create_manager' (c4f72994-565a-42bc-ad0a-9bd9d8966ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3f35fa-39e3-4231-8b4d-f0cc4f935d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3f35fa-39e3-4231-8b4d-f0cc4f935d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-616455768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3189de-f0c4-4ba2-8e2d-1e39514fdaea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c470705f07d45218e821d53279ba486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:49:17Z,use_quota=True,user_id='eb3edf37b20b4aa083efbc208ca74971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9e10f7-ebbf-4c11-ab56-312edd32c13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9e10f7-ebbf-4c11-ab56-312edd32c13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d194fcdf-807a-4d06-999c-2337e66a1096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d194fcdf-807a-4d06-999c-2337e66a1096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab3189de-f0c4-4ba2-8e2d-1e39514fdaea', 'volume_name': 'volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4394e485-245b-49f3-98cc-9e2af7d8d4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4394e485-245b-49f3-98cc-9e2af7d8d4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4cd65c2-328b-4d65-b057-792a4c808cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:17 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Volume ab3189de-f0c4-4ba2-8e2d-1e39514fdaea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea', 'volume_size': 1} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-616455768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3189de-f0c4-4ba2-8e2d-1e39514fdaea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c470705f07d45218e821d53279ba486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:49:17Z,use_quota=True,user_id='eb3edf37b20b4aa083efbc208ca74971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Creating volume ab3189de-f0c4-4ba2-8e2d-1e39514fdaea {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:49:17 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:17 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea 1073741824 Jul 08 02:49:17 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Flow 'volume_create_manager' (5fa4e5de-216f-4f2d-8ba2-447c1dba1c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68707dde-aa3c-482c-9b73-74beaa4b82a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68707dde-aa3c-482c-9b73-74beaa4b82a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-50709824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5109db90-06fd-4823-8ba8-e47b573dc89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c470705f07d45218e821d53279ba486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:49:18Z,use_quota=True,user_id='eb3edf37b20b4aa083efbc208ca74971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d0bab77-37a7-4b83-b692-c7747929ccf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d0bab77-37a7-4b83-b692-c7747929ccf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8d65c6-5d2d-4472-8f79-557479fe3375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8d65c6-5d2d-4472-8f79-557479fe3375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5109db90-06fd-4823-8ba8-e47b573dc89f', 'volume_name': 'volume-5109db90-06fd-4823-8ba8-e47b573dc89f', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44db74e-672f-4c1b-8bcc-16c3cfba392b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44db74e-672f-4c1b-8bcc-16c3cfba392b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15241523-1802-4c1a-b0aa-66dd98084c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:17 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Volume 5109db90-06fd-4823-8ba8-e47b573dc89f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5109db90-06fd-4823-8ba8-e47b573dc89f', 'volume_size': 1} Jul 08 02:49:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:18 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e.d6fcafb3-5482-46ab-9bed-6e3031e12a18" returned: 0 in 0.878s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-d6fcafb3-5482-46ab-9bed-6e3031e12a18" released by "_delete_snapshot" :: held 3.582s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-98e0c4eb-724b-46ac-9841-f6577d2f447e" released by "delete_snapshot" :: held 3.609s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:18 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Created reservations ['afa5ee21-33bf-46e4-b862-90a507163397', 'c2069df5-3d21-4319-9d7b-60e0219fc830', '29140032-373d-4015-a618-022b8499a8e8', '18c3412e-dc7b-4895-ae76-a3944adb6df6'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:49:18 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Delete snapshot completed successfully. Jul 08 02:49:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-d6fcafb3-5482-46ab-9bed-6e3031e12a18-delete_snapshot" released by "delete_snapshot" :: held 3.797s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Snapshots deleted, issuing volume delete {{(pid=87238) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 02:49:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-quobyte-98e0c4eb-724b-46ac-9841-f6577d2f447e" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-98e0c4eb-724b-46ac-9841-f6577d2f447e" acquired by "delete_volume" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:18 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed391f25-c38b-4066-9f87-e451a467bd91]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:18 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e Jul 08 02:49:18 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:18 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea 1073741824" returned: 0 in 1.017s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:18 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea Jul 08 02:49:18 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:19 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e" returned: 0 in 0.882s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:19 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e Jul 08 02:49:19 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:19 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea" returned: 0 in 0.775s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.416s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-50709824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5109db90-06fd-4823-8ba8-e47b573dc89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c470705f07d45218e821d53279ba486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:49:18Z,use_quota=True,user_id='eb3edf37b20b4aa083efbc208ca74971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Creating volume 5109db90-06fd-4823-8ba8-e47b573dc89f {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:49:19 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5109db90-06fd-4823-8ba8-e47b573dc89f 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4cd65c2-328b-4d65-b057-792a4c808cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e9ecc3-30d7-463a-9048-17c10a9cb9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:19 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5109db90-06fd-4823-8ba8-e47b573dc89f 1073741824 Jul 08 02:49:19 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:19 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Volume volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea (ab3189de-f0c4-4ba2-8e2d-1e39514fdaea): created successfully Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e9ecc3-30d7-463a-9048-17c10a9cb9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Flow 'volume_create_manager' (c4f72994-565a-42bc-ad0a-9bd9d8966ee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:49:19 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-97b59f1b-f14e-4bc1-ba7c-9bd7cf0da99c tempest-TestServerVolumeAttachmentScenario-1849281685 None] Created volume successfully. Jul 08 02:49:20 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-98e0c4eb-724b-46ac-9841-f6577d2f447e" returned: 0 in 0.724s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-98e0c4eb-724b-46ac-9841-f6577d2f447e" released by "delete_volume" :: held 1.669s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:20 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Created reservations ['de5f1392-d4b0-417a-a3c7-b35f03ccef56', '129f323a-a777-4166-8d03-8eee4b211ff1', '6827c13c-2dc6-434f-b4cd-729492d9a0e3', 'be05285a-749f-44ca-bb8a-b2d6d25be078'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:49:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:49:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:49:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:20 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:49:20 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:20 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5109db90-06fd-4823-8ba8-e47b573dc89f 1073741824" returned: 0 in 0.926s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5109db90-06fd-4823-8ba8-e47b573dc89f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:20 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5109db90-06fd-4823-8ba8-e47b573dc89f Jul 08 02:49:20 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:20 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.729s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:20 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:49:20 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Deleted volume successfully. Jul 08 02:49:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2d4edd10-7400-497a-ab6c-757f3e7c223e tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-98e0c4eb-724b-46ac-9841-f6577d2f447e-delete_volume" released by "delete_volume" :: held 14.267s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:21 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5109db90-06fd-4823-8ba8-e47b573dc89f" returned: 0 in 0.721s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15241523-1802-4c1a-b0aa-66dd98084c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5109db90-06fd-4823-8ba8-e47b573dc89f', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d3697a-22a4-441b-b7ea-4ae1d1284691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:21 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Volume volume-5109db90-06fd-4823-8ba8-e47b573dc89f (5109db90-06fd-4823-8ba8-e47b573dc89f): created successfully Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d3697a-22a4-441b-b7ea-4ae1d1284691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Flow 'volume_create_manager' (5fa4e5de-216f-4f2d-8ba2-447c1dba1c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:49:21 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-42b460e9-ab4c-40e0-aab1-b2704f1ac6bf tempest-TestServerVolumeAttachmentScenario-1849281685 None] Created volume successfully. Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Flow 'volume_create_manager' (ce90ed60-b4e3-4a31-ab0f-6bb7e58cd0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c6281e-bac7-4a66-b368-aeb20250dde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c6281e-bac7-4a66-b368-aeb20250dde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1305774636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23284e32-3e39-4676-9382-00f844832d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0658c23c202e470a83ee9f04a26cb033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:49:22Z,use_quota=True,user_id='80872ceb619c4bf5b892f51b1230da99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ec89c4-c048-4b1e-8d2e-5d953bad8149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ec89c4-c048-4b1e-8d2e-5d953bad8149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26846227-ea0c-4518-b009-91a7dbee69ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26846227-ea0c-4518-b009-91a7dbee69ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23284e32-3e39-4676-9382-00f844832d58', 'volume_name': 'volume-23284e32-3e39-4676-9382-00f844832d58', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f51c95-5b1b-40f2-8cec-4735c6fb6f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f51c95-5b1b-40f2-8cec-4735c6fb6f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7197723c-f26a-4f42-a516-75c0f6de6329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:21 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Volume 23284e32-3e39-4676-9382-00f844832d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23284e32-3e39-4676-9382-00f844832d58', 'volume_size': 1} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1305774636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23284e32-3e39-4676-9382-00f844832d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0658c23c202e470a83ee9f04a26cb033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:49:22Z,use_quota=True,user_id='80872ceb619c4bf5b892f51b1230da99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Creating volume 23284e32-3e39-4676-9382-00f844832d58 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:49:21 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:49:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:21 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 1073741824 Jul 08 02:49:21 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:22 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 1073741824" returned: 0 in 0.848s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:22 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 Jul 08 02:49:22 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:23 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58" returned: 0 in 0.657s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:49:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7197723c-f26a-4f42-a516-75c0f6de6329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23284e32-3e39-4676-9382-00f844832d58', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887b4a91-1eed-4e83-acc2-fd2c7f05b6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:23 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Volume volume-23284e32-3e39-4676-9382-00f844832d58 (23284e32-3e39-4676-9382-00f844832d58): created successfully Jul 08 02:49:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887b4a91-1eed-4e83-acc2-fd2c7f05b6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Flow 'volume_create_manager' (ce90ed60-b4e3-4a31-ab0f-6bb7e58cd0fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:49:23 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ac7ade35-2b1c-4b58-a5c4-37995c24f9c9 tempest-VolumesDeleteCascade-1925987541 None] Created volume successfully. Jul 08 02:49:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] Creating offline snapshot 46669aeb-a80a-44b5-8372-72642bd7ac53 of volume 23284e32-3e39-4676-9382-00f844832d58 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:49:24 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[9204bc91-2162-4166-a0ec-b66925d18652]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:24 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 Jul 08 02:49:24 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:24 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58" returned: 0 in 0.795s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:24 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 1G Jul 08 02:49:24 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:25 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 1G" returned: 0 in 0.802s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23284e32-3e39-4676-9382-00f844832d58 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:25 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23284e32-3e39-4676-9382-00f844832d58 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 Jul 08 02:49:25 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:26 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23284e32-3e39-4676-9382-00f844832d58 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53" returned: 0 in 0.851s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:26 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 is being set with open permissions: ugo+rw Jul 08 02:49:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:26 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 Jul 08 02:49:26 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:27 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53" returned: 0 in 0.826s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:27 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.info Jul 08 02:49:27 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:28 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.info" returned: 0 in 0.835s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:28 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.info is being set with open permissions: ugo+rw Jul 08 02:49:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:28 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.info Jul 08 02:49:28 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:28 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.info" returned: 0 in 0.796s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.027s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:29 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3a670892-a98c-4cf0-ad0c-b62de84437c0 tempest-VolumesDeleteCascade-1925987541 None] Create snapshot completed successfully Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Flow 'volume_create_manager' (7356a497-5461-4c11-8615-19d821a3fb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57dcd662-ebfd-4bf8-b207-fc507f3f8725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57dcd662-ebfd-4bf8-b207-fc507f3f8725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1538017299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4af86ba-37d8-4c16-bc0c-f829bd64d4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0658c23c202e470a83ee9f04a26cb033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46669aeb-a80a-44b5-8372-72642bd7ac53,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:49:30Z,use_quota=True,user_id='80872ceb619c4bf5b892f51b1230da99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f031e9f5-f5e1-4c92-b401-e2038c0520e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f031e9f5-f5e1-4c92-b401-e2038c0520e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1ff08c-4c32-472d-a91c-d9201468ac3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1ff08c-4c32-472d-a91c-d9201468ac3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a4af86ba-37d8-4c16-bc0c-f829bd64d4a3', 'volume_name': 'volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3', 'volume_size': 1, 'snapshot_id': '46669aeb-a80a-44b5-8372-72642bd7ac53'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21bf560-0c22-4315-a5e5-0d26ffba2fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21bf560-0c22-4315-a5e5-0d26ffba2fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c925d1-c0c6-464f-a306-0eb3b01050f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:29 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Volume a4af86ba-37d8-4c16-bc0c-f829bd64d4a3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3', 'volume_size': 1, 'snapshot_id': '46669aeb-a80a-44b5-8372-72642bd7ac53'} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-quobyte-46669aeb-a80a-44b5-8372-72642bd7ac53-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3" by "_create_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-46669aeb-a80a-44b5-8372-72642bd7ac53-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Creating volume a4af86ba-37d8-4c16-bc0c-f829bd64d4a3 from snapshot 46669aeb-a80a-44b5-8372-72642bd7ac53 {{(pid=87238) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-quobyte-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3" by "_copy_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] snapshot: 46669aeb-a80a-44b5-8372-72642bd7ac53, volume: a4af86ba-37d8-4c16-bc0c-f829bd64d4a3, {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 02:49:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:49:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:49:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:30 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1761090-4a13-4730-b376-67d4ecd1b1ff]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:30 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 Jul 08 02:49:30 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:30 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-da7bc6f2-7019-4dc8-8140-29bffe72a80c req-3a134372-6687-4122-8806-e02348da8910 tempest-TestMinimumBasicScenario-277539432 None] Terminate volume connection completed successfully. Jul 08 02:49:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-da7bc6f2-7019-4dc8-8140-29bffe72a80c req-3a134372-6687-4122-8806-e02348da8910 tempest-TestMinimumBasicScenario-277539432 None] Deleting attachment 96e0389d-c8db-42e4-9d79-2450e8e5e104. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:49:31 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53" returned: 0 in 0.988s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23284e32-3e39-4676-9382-00f844832d58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:49:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 02:49:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Creating direct copy from snapshot {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 02:49:31 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c935b7-6782-4291-a08d-ee8456aff4ed]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:31 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 Jul 08 02:49:31 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:31 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58" returned: 0 in 0.892s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:31 devstack cinder-volume[87238]: DEBUG cinder.utils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Path /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3 not found in is_blk_device check {{(pid=87238) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 02:49:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:31 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3 Jul 08 02:49:31 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Acquiring lock "cinder-00963b65-ba9e-4b4e-ac20-6c37fb4d0476-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Lock "cinder-00963b65-ba9e-4b4e-ac20-6c37fb4d0476-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Acquiring lock "cinder-quobyte-00963b65-ba9e-4b4e-ac20-6c37fb4d0476" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Lock "cinder-quobyte-00963b65-ba9e-4b4e-ac20-6c37fb4d0476" acquired by "delete_volume" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:32 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[561c99d3-f713-47b8-84e6-dfba3e05a009]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:32 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476 Jul 08 02:49:32 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:34 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476" returned: 0 in 1.969s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:34 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476 Jul 08 02:49:34 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:37 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00963b65-ba9e-4b4e-ac20-6c37fb4d0476" returned: 0 in 2.803s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Lock "cinder-quobyte-00963b65-ba9e-4b4e-ac20-6c37fb4d0476" released by "delete_volume" :: held 4.855s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:37 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Created reservations ['ce26b948-016b-4ba4-8eb1-88e33b95a37d', '1c3e0fad-ba1c-4109-b466-648aa1690fa2', '317f09dd-5cba-4606-906e-33e37fa9cfed', '7f42fd46-7c78-4f52-a676-628eb4ea20a3'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:49:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:49:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:49:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:38 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:49:38 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:39 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.953s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:39 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:49:39 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Deleted volume successfully. Jul 08 02:49:39 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3" returned: 0 in 7.958s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:39 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[89054c7f-b4b5-4521-a6d7-51d921d2dd3e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8c522723-dc66-4f57-872b-235cd6450989 tempest-TestMinimumBasicScenario-277539432 None] Lock "cinder-00963b65-ba9e-4b4e-ac20-6c37fb4d0476-delete_volume" released by "delete_volume" :: held 7.418s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:40 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 Jul 08 02:49:40 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:41 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58" returned: 0 in 1.223s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:41 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58, size 1024.00 MB, duration 7.96 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:49:41 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Converted 1024.00 MB image at 128.63 MB/s Jul 08 02:49:41 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3 is being set with open permissions: ugo+rw Jul 08 02:49:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:41 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3 Jul 08 02:49:41 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:42 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3" returned: 0 in 1.094s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3" released by "_copy_volume_from_snapshot" :: held 12.317s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-46669aeb-a80a-44b5-8372-72642bd7ac53-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3" released by "_create_volume_from_snapshot" :: held 12.361s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.392s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c925d1-c0c6-464f-a306-0eb3b01050f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3', 'volume_size': 1, 'snapshot_id': '46669aeb-a80a-44b5-8372-72642bd7ac53'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e736f297-8c03-4cfb-a6c2-884c1dcbd10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:42 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Volume volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3 (a4af86ba-37d8-4c16-bc0c-f829bd64d4a3): created successfully Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e736f297-8c03-4cfb-a6c2-884c1dcbd10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Flow 'volume_create_manager' (7356a497-5461-4c11-8615-19d821a3fb0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:49:42 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5b748a6d-f2fa-40da-9b2f-141dc6c45b17 tempest-VolumesDeleteCascade-1925987541 None] Created volume successfully. Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-23284e32-3e39-4676-9382-00f844832d58-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-23284e32-3e39-4676-9382-00f844832d58-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Performing cascade delete. {{(pid=87238) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-46669aeb-a80a-44b5-8372-72642bd7ac53-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-46669aeb-a80a-44b5-8372-72642bd7ac53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-quobyte-23284e32-3e39-4676-9382-00f844832d58" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-23284e32-3e39-4676-9382-00f844832d58" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-quobyte-46669aeb-a80a-44b5-8372-72642bd7ac53" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-46669aeb-a80a-44b5-8372-72642bd7ac53" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Deleting offline snapshot 46669aeb-a80a-44b5-8372-72642bd7ac53 of volume 23284e32-3e39-4676-9382-00f844832d58 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] snapshot_file for this snap is: volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1013b2f-7e77-43df-b60d-4e85b6bf0e7f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:42 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 Jul 08 02:49:42 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:43 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53" returned: 0 in 0.807s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23284e32-3e39-4676-9382-00f844832d58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:49:43 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc15651f-d052-4cf5-b659-e99b48bf16b1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:43 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 Jul 08 02:49:43 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:44 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58" returned: 0 in 0.815s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:44 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 Jul 08 02:49:44 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:45 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53" returned: 0 in 0.771s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:45 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53 Jul 08 02:49:45 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:45 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58.46669aeb-a80a-44b5-8372-72642bd7ac53" returned: 0 in 0.674s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-46669aeb-a80a-44b5-8372-72642bd7ac53" released by "_delete_snapshot" :: held 3.185s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-23284e32-3e39-4676-9382-00f844832d58" released by "delete_snapshot" :: held 3.210s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:46 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Created reservations ['b78343b1-1edd-4897-955f-fb8f82c8fb67', 'a70d2501-3245-49fb-bb7e-0d106220b0de', '10d866d7-3847-4c98-84bd-0879c7cc5828', '6b6cc140-9995-4ea4-8b0f-184986ef8043'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:49:46 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Delete snapshot completed successfully. Jul 08 02:49:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-46669aeb-a80a-44b5-8372-72642bd7ac53-delete_snapshot" released by "delete_snapshot" :: held 3.398s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:46 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Snapshots deleted, issuing volume delete {{(pid=87238) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 02:49:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-quobyte-23284e32-3e39-4676-9382-00f844832d58" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-23284e32-3e39-4676-9382-00f844832d58" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:46 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bcdb55-0be0-414c-ac75-6850087c14d5]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:46 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 Jul 08 02:49:46 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:47 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58" returned: 0 in 0.909s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:47 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58 Jul 08 02:49:47 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:47 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:49:47 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:47 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-23284e32-3e39-4676-9382-00f844832d58" returned: 0 in 0.716s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-23284e32-3e39-4676-9382-00f844832d58" released by "delete_volume" :: held 1.706s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:47 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.688s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Created reservations ['213f112b-2135-49a4-8e14-dd166d335d7a', '9ed8ff08-602a-45be-9efc-a3c170bc389c', 'f09ee567-c913-4650-8373-9b07bd6cfea1', '5fbde833-4ba1-416e-a599-5e9bf837594e'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:49:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:49:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:49:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:49:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:48 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:49:48 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "cinder-quobyte-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:49:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3" acquired by "delete_volume" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:49:48 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafe1d2e-6829-42bb-9be5-7a606a204552]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:48 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3 Jul 08 02:49:48 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:48 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.754s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:49:48 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Deleted volume successfully. Jul 08 02:49:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32ccdef5-8133-455f-99cd-9adb0e454832 tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-23284e32-3e39-4676-9382-00f844832d58-delete_volume" released by "delete_volume" :: held 6.118s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:49 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3" returned: 0 in 0.880s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:49 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3 Jul 08 02:49:49 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:50 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3" returned: 0 in 0.719s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-quobyte-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3" released by "delete_volume" :: held 1.642s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:50 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Created reservations ['5dc80efe-7e46-464d-8de8-0862b5a0a74e', '2cd181bd-4b7b-4595-af64-42618242a34e', '5e560d24-9a32-4a59-8e1f-0f3d219c1340', 'a1eb62fc-40eb-4e62-9fc2-faef380d3a56'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:49:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:49:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:49:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:50 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:49:50 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:50 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.702s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:50 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:49:50 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Deleted volume successfully. Jul 08 02:49:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e5684b42-1cbb-472d-acd1-af92e1e4ebae tempest-VolumesDeleteCascade-1925987541 None] Lock "cinder-a4af86ba-37d8-4c16-bc0c-f829bd64d4a3-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=64,cinder:INSERT=18,cinder:UPDATE=60,cinder:DELETE=4 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=73,cinder:DELETE=8,cinder:SELECT=50,cinder:INSERT=16 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Flow 'volume_create_manager' (3a830138-10b9-4e3b-a27f-3d2597cf4b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b5fb59-f920-4024-b166-5eec87d678cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b5fb59-f920-4024-b166-5eec87d678cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1243164059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3674728f-ea22-4971-9b38-cef002dba17e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315c3f60b25b41b6b7ff3cd0e4743db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:49:54Z,use_quota=True,user_id='f301fb8627d8406ea61a4cb5062c8e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adab154a-0031-4f13-8270-f48d57a127e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adab154a-0031-4f13-8270-f48d57a127e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ce3134-bb36-4cc2-921a-d7390c2d0dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ce3134-bb36-4cc2-921a-d7390c2d0dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3674728f-ea22-4971-9b38-cef002dba17e', 'volume_name': 'volume-3674728f-ea22-4971-9b38-cef002dba17e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52dc313-bf21-4527-a569-22e4ec35997a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52dc313-bf21-4527-a569-22e4ec35997a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c3b5f2-70ff-429f-940a-b8092a9015a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:53 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Volume 3674728f-ea22-4971-9b38-cef002dba17e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3674728f-ea22-4971-9b38-cef002dba17e', 'volume_size': 1} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1243164059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3674728f-ea22-4971-9b38-cef002dba17e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315c3f60b25b41b6b7ff3cd0e4743db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:49:54Z,use_quota=True,user_id='f301fb8627d8406ea61a4cb5062c8e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Creating volume 3674728f-ea22-4971-9b38-cef002dba17e {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:49:53 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:49:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:54 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e 1073741824 Jul 08 02:49:54 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:54 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e 1073741824" returned: 0 in 0.959s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:55 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e Jul 08 02:49:55 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:55 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e" returned: 0 in 0.724s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:49:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:49:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c3b5f2-70ff-429f-940a-b8092a9015a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3674728f-ea22-4971-9b38-cef002dba17e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ad4d96-bfce-49a3-9aae-999503174f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:55 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Volume volume-3674728f-ea22-4971-9b38-cef002dba17e (3674728f-ea22-4971-9b38-cef002dba17e): created successfully Jul 08 02:49:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ad4d96-bfce-49a3-9aae-999503174f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Flow 'volume_create_manager' (3a830138-10b9-4e3b-a27f-3d2597cf4b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:49:55 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-33966faf-7b0f-4429-b41e-9c9f1fd748eb tempest-VolumesCloneTest-1294763216 None] Created volume successfully. Jul 08 02:49:56 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:49:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Flow 'volume_create_manager' (f0725002-3d3b-4d1d-862b-5462cad1a099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:49:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a1bbfb-d519-4c43-9636-50e956326db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a1bbfb-d519-4c43-9636-50e956326db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1995208660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57373f4e-bb1b-45ff-ab23-2f808685ba95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315c3f60b25b41b6b7ff3cd0e4743db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:49:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3674728f-ea22-4971-9b38-cef002dba17e,status='creating',terminated_at=None,updated_at=2026-07-08T00:49:56Z,use_quota=True,user_id='f301fb8627d8406ea61a4cb5062c8e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5ceec3-db77-47e5-9f83-e9119da2e84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5ceec3-db77-47e5-9f83-e9119da2e84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67681f9f-298a-4dc7-923c-54559fc8065b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67681f9f-298a-4dc7-923c-54559fc8065b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '57373f4e-bb1b-45ff-ab23-2f808685ba95', 'volume_name': 'volume-57373f4e-bb1b-45ff-ab23-2f808685ba95', 'volume_size': 2, 'source_volid': '3674728f-ea22-4971-9b38-cef002dba17e', 'source_volstatus': 'available'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d11787f-7d88-4798-927e-9d9dee83ede8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d11787f-7d88-4798-927e-9d9dee83ede8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:49:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb153cd1-4bc9-41e5-b0af-6c7041971472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:49:56 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Volume 57373f4e-bb1b-45ff-ab23-2f808685ba95: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-57373f4e-bb1b-45ff-ab23-2f808685ba95', 'volume_size': 2, 'source_volid': '3674728f-ea22-4971-9b38-cef002dba17e', 'source_volstatus': 'available'} Jul 08 02:49:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:49:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:49:56 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Cloning volume 3674728f-ea22-4971-9b38-cef002dba17e to volume 57373f4e-bb1b-45ff-ab23-2f808685ba95 Jul 08 02:49:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Creating offline snapshot 8f1670ea-d061-4a88-8ad4-09fa1a596387 of volume 3674728f-ea22-4971-9b38-cef002dba17e {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:49:56 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fc9902-1d34-4823-bc9b-fa50133ae70d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:49:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:56 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e Jul 08 02:49:56 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:57 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e" returned: 0 in 0.842s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:57 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 1G Jul 08 02:49:57 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:58 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 1G" returned: 0 in 0.821s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3674728f-ea22-4971-9b38-cef002dba17e -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:58 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3674728f-ea22-4971-9b38-cef002dba17e -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 Jul 08 02:49:58 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:59 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3674728f-ea22-4971-9b38-cef002dba17e -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387" returned: 0 in 0.725s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:59 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 is being set with open permissions: ugo+rw Jul 08 02:49:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:59 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 Jul 08 02:49:59 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:49:59 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 08 02:49:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387" returned: 0 in 0.659s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:49:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:49:59 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.info Jul 08 02:49:59 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:00 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.info" returned: 0 in 0.659s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:00 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.info is being set with open permissions: ugo+rw Jul 08 02:50:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:00 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.info Jul 08 02:50:00 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:01 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.info" returned: 0 in 0.842s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:01 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Acquiring lock "cinder-quobyte-57373f4e-bb1b-45ff-ab23-2f808685ba95" by "_copy_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:50:01 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Lock "cinder-quobyte-57373f4e-bb1b-45ff-ab23-2f808685ba95" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:50:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] snapshot: 8f1670ea-d061-4a88-8ad4-09fa1a596387, volume: 57373f4e-bb1b-45ff-ab23-2f808685ba95, {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 02:50:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:50:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:50:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:01 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0557e4-cb17-45cc-b2b2-ed84b9b668c1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:50:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:01 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 Jul 08 02:50:01 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:02 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387" returned: 0 in 0.803s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3674728f-ea22-4971-9b38-cef002dba17e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:50:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 02:50:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Creating direct copy from snapshot {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 02:50:02 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[979f01b0-3f15-4146-998d-63df52b95b29]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:50:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:02 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e Jul 08 02:50:02 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:03 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e" returned: 0 in 0.955s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:03 devstack cinder-volume[87238]: DEBUG cinder.utils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Path /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-57373f4e-bb1b-45ff-ab23-2f808685ba95 not found in is_blk_device check {{(pid=87238) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 02:50:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-57373f4e-bb1b-45ff-ab23-2f808685ba95 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:03 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-57373f4e-bb1b-45ff-ab23-2f808685ba95 Jul 08 02:50:03 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-f5d30107-a12a-4245-99b7-6631a9636ce8 req-e0f5dcc9-97e9-44e9-8e80-87e0437648f6 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:09 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-57373f4e-bb1b-45ff-ab23-2f808685ba95" returned: 0 in 6.089s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:09 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[71694176-9ed3-455e-a4be-a9d40746fb83]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:50:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:09 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e Jul 08 02:50:09 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:10 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e" returned: 0 in 1.005s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:10 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-57373f4e-bb1b-45ff-ab23-2f808685ba95 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:50:10 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Converted 1024.00 MB image at 168.14 MB/s Jul 08 02:50:10 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-57373f4e-bb1b-45ff-ab23-2f808685ba95 is being set with open permissions: ugo+rw Jul 08 02:50:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-57373f4e-bb1b-45ff-ab23-2f808685ba95 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:10 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-57373f4e-bb1b-45ff-ab23-2f808685ba95 Jul 08 02:50:10 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:10 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-57373f4e-bb1b-45ff-ab23-2f808685ba95" returned: 0 in 0.666s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Lock "cinder-quobyte-57373f4e-bb1b-45ff-ab23-2f808685ba95" released by "_copy_volume_from_snapshot" :: held 9.646s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:50:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Acquiring lock "cinder-quobyte-8f1670ea-d061-4a88-8ad4-09fa1a596387" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:50:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Lock "cinder-quobyte-8f1670ea-d061-4a88-8ad4-09fa1a596387" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:50:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Deleting offline snapshot 8f1670ea-d061-4a88-8ad4-09fa1a596387 of volume 3674728f-ea22-4971-9b38-cef002dba17e {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:50:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] snapshot_file for this snap is: volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:50:11 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea7f3c0-ada2-421b-87c0-bb18898f30cd]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:50:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:11 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 Jul 08 02:50:11 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:11 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387" returned: 0 in 0.831s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3674728f-ea22-4971-9b38-cef002dba17e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:50:11 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b5c86c-9f1b-40d5-bc46-5c12df05e6bc]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:50:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:11 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e Jul 08 02:50:11 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:12 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e" returned: 0 in 0.805s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:12 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 Jul 08 02:50:12 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:13 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387" returned: 0 in 0.806s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:13 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387 Jul 08 02:50:13 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:14 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e.8f1670ea-d061-4a88-8ad4-09fa1a596387" returned: 0 in 0.769s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Lock "cinder-quobyte-8f1670ea-d061-4a88-8ad4-09fa1a596387" released by "_delete_snapshot" :: held 3.321s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:50:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.769s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-f5d30107-a12a-4245-99b7-6631a9636ce8 req-e0f5dcc9-97e9-44e9-8e80-87e0437648f6 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.776s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb153cd1-4bc9-41e5-b0af-6c7041971472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57373f4e-bb1b-45ff-ab23-2f808685ba95', 'volume_size': 2, 'source_volid': '3674728f-ea22-4971-9b38-cef002dba17e', 'source_volstatus': 'available'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178a8143-f546-424e-9d47-7934813be59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:14 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c65773f-5abd-4d04-b2ee-3b9b4ff700e6]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:50:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-f5d30107-a12a-4245-99b7-6631a9636ce8 req-e0f5dcc9-97e9-44e9-8e80-87e0437648f6 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:14 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Volume volume-57373f4e-bb1b-45ff-ab23-2f808685ba95 (57373f4e-bb1b-45ff-ab23-2f808685ba95): created successfully Jul 08 02:50:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178a8143-f546-424e-9d47-7934813be59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Flow 'volume_create_manager' (f0725002-3d3b-4d1d-862b-5462cad1a099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:50:14 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-68762333-6dfa-4c88-af02-df8dd45ddb7e tempest-VolumesCloneTest-1294763216 None] Created volume successfully. Jul 08 02:50:14 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea Jul 08 02:50:14 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Acquiring lock "cinder-57373f4e-bb1b-45ff-ab23-2f808685ba95-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:50:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Lock "cinder-57373f4e-bb1b-45ff-ab23-2f808685ba95-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:50:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Acquiring lock "cinder-quobyte-57373f4e-bb1b-45ff-ab23-2f808685ba95" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:50:15 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Lock "cinder-quobyte-57373f4e-bb1b-45ff-ab23-2f808685ba95" acquired by "delete_volume" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:50:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-f5d30107-a12a-4245-99b7-6631a9636ce8 req-e0f5dcc9-97e9-44e9-8e80-87e0437648f6 tempest-TestServerVolumeAttachmentScenario-1849281685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea" returned: 0 in 0.954s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-f5d30107-a12a-4245-99b7-6631a9636ce8 req-e0f5dcc9-97e9-44e9-8e80-87e0437648f6 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.019s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:15 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[489830c0-8ec0-46ee-9e4d-a55d060bc7cd]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:50:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-57373f4e-bb1b-45ff-ab23-2f808685ba95 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-f5d30107-a12a-4245-99b7-6631a9636ce8 req-e0f5dcc9-97e9-44e9-8e80-87e0437648f6 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a112204-67a5-4bce-812f-0f5a3f265215', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:50:15 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-f5d30107-a12a-4245-99b7-6631a9636ce8 req-e0f5dcc9-97e9-44e9-8e80-87e0437648f6 tempest-TestServerVolumeAttachmentScenario-1849281685 None] attachment_update completed successfully. Jul 08 02:50:15 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-57373f4e-bb1b-45ff-ab23-2f808685ba95 Jul 08 02:50:15 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:16 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-57373f4e-bb1b-45ff-ab23-2f808685ba95" returned: 0 in 0.916s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-57373f4e-bb1b-45ff-ab23-2f808685ba95 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:16 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-57373f4e-bb1b-45ff-ab23-2f808685ba95 Jul 08 02:50:16 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:17 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-57373f4e-bb1b-45ff-ab23-2f808685ba95" returned: 0 in 0.715s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Lock "cinder-quobyte-57373f4e-bb1b-45ff-ab23-2f808685ba95" released by "delete_volume" :: held 1.700s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Created reservations ['d09b1cd0-9ed8-4c4c-b206-e2bc405073af', '838d9eda-62d1-4dec-aeae-a25503d6ee0f', 'bdb9f4db-855f-4c07-83ba-ca4727c3e4ae', '74cb1c1b-1407-485a-ad7a-305fde82bf69'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:17 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:50:17 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Acquiring lock "cinder-3674728f-ea22-4971-9b38-cef002dba17e-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Lock "cinder-3674728f-ea22-4971-9b38-cef002dba17e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Acquiring lock "cinder-quobyte-3674728f-ea22-4971-9b38-cef002dba17e" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Lock "cinder-quobyte-3674728f-ea22-4971-9b38-cef002dba17e" acquired by "delete_volume" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[86995d6e-ccd5-4398-a73a-1e8cbf2873dc]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:17 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e Jul 08 02:50:17 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:17 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.804s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:17 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:50:18 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Deleted volume successfully. Jul 08 02:50:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d76749d0-1971-47df-8323-6ef3cd850e57 tempest-VolumesCloneTest-1294763216 None] Lock "cinder-57373f4e-bb1b-45ff-ab23-2f808685ba95-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:50:18 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e" returned: 0 in 0.822s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:18 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e Jul 08 02:50:18 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:19 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3674728f-ea22-4971-9b38-cef002dba17e" returned: 0 in 0.685s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Lock "cinder-quobyte-3674728f-ea22-4971-9b38-cef002dba17e" released by "delete_volume" :: held 1.651s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:50:19 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Created reservations ['4c3f5093-7037-404e-9d9e-d217db6e111b', '311649a4-d545-4053-a574-804ef52971c1', 'a34ecc42-c393-42e8-a980-d70aea74e65d', '416ac19f-d5db-4371-a5bf-b21fb26f8f08'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:50:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:50:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:50:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:19 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:50:19 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:20 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.790s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:20 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:50:20 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Deleted volume successfully. Jul 08 02:50:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a59b6bdb-78eb-41af-8285-89439ee65e07 tempest-VolumesCloneTest-1294763216 None] Lock "cinder-3674728f-ea22-4971-9b38-cef002dba17e-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Flow 'volume_create_manager' (611d8327-efe3-418e-8b58-4aeacf8bc53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad111682-a455-4021-8db2-9ed2cea192c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad111682-a455-4021-8db2-9ed2cea192c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-530856521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac60dda-a9a8-4340-8361-8e12a919a12f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32e26622f0cf4114bd8b41ae4ffef805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:50:26Z,use_quota=True,user_id='7efd22b19d224d3eb255b7c5a40ec420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4847103d-b4c5-44e6-85a8-eae154ba16c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4847103d-b4c5-44e6-85a8-eae154ba16c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d8bcca-bebd-4fa3-b9d6-c281389df0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d8bcca-bebd-4fa3-b9d6-c281389df0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ac60dda-a9a8-4340-8361-8e12a919a12f', 'volume_name': 'volume-1ac60dda-a9a8-4340-8361-8e12a919a12f', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3912fb2b-eb4c-4e53-bdbf-d6f4909f5566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3912fb2b-eb4c-4e53-bdbf-d6f4909f5566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32adcdbe-a64f-4c27-848b-fccd2e6ed8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:25 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Volume 1ac60dda-a9a8-4340-8361-8e12a919a12f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ac60dda-a9a8-4340-8361-8e12a919a12f', 'volume_size': 1} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-530856521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac60dda-a9a8-4340-8361-8e12a919a12f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32e26622f0cf4114bd8b41ae4ffef805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:50:26Z,use_quota=True,user_id='7efd22b19d224d3eb255b7c5a40ec420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Creating volume 1ac60dda-a9a8-4340-8361-8e12a919a12f {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:50:25 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:50:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1ac60dda-a9a8-4340-8361-8e12a919a12f 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:25 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1ac60dda-a9a8-4340-8361-8e12a919a12f 1073741824 Jul 08 02:50:25 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-4a1ac57f-be14-401a-8f38-912b9fda3890 req-0d5ecf53-85a8-4f13-8bfe-1bd7836d2618 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:26 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1ac60dda-a9a8-4340-8361-8e12a919a12f 1073741824" returned: 0 in 0.891s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1ac60dda-a9a8-4340-8361-8e12a919a12f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:26 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1ac60dda-a9a8-4340-8361-8e12a919a12f Jul 08 02:50:26 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:27 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1ac60dda-a9a8-4340-8361-8e12a919a12f" returned: 0 in 0.753s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:50:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-4a1ac57f-be14-401a-8f38-912b9fda3890 req-0d5ecf53-85a8-4f13-8bfe-1bd7836d2618 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.266s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32adcdbe-a64f-4c27-848b-fccd2e6ed8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ac60dda-a9a8-4340-8361-8e12a919a12f', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bec3f12-31c3-4b57-8f67-49931e224065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:27 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffa584f-dff5-4494-af35-b40b4cdb2998]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:50:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-4a1ac57f-be14-401a-8f38-912b9fda3890 req-0d5ecf53-85a8-4f13-8bfe-1bd7836d2618 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5109db90-06fd-4823-8ba8-e47b573dc89f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:27 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Volume volume-1ac60dda-a9a8-4340-8361-8e12a919a12f (1ac60dda-a9a8-4340-8361-8e12a919a12f): created successfully Jul 08 02:50:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bec3f12-31c3-4b57-8f67-49931e224065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:27 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Flow 'volume_create_manager' (611d8327-efe3-418e-8b58-4aeacf8bc53d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:50:27 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2f20354a-25f8-4af1-87ec-4b65ade649df tempest-VolumesListTestJSON-1105425353 None] Created volume successfully. Jul 08 02:50:27 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5109db90-06fd-4823-8ba8-e47b573dc89f Jul 08 02:50:27 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Flow 'volume_create_manager' (bdad4407-5b28-46bf-9ea3-f5b42ae0ce37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45392f7f-9b50-473e-b035-d436bf06a6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45392f7f-9b50-473e-b035-d436bf06a6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1959431765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c609f2-f4f5-4313-980f-4e109c54adce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32e26622f0cf4114bd8b41ae4ffef805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:50:29Z,use_quota=True,user_id='7efd22b19d224d3eb255b7c5a40ec420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2366d8e-8986-4b54-ab19-105dcbda2a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2366d8e-8986-4b54-ab19-105dcbda2a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab9e059-8c19-4b7a-a654-3df3390779d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab9e059-8c19-4b7a-a654-3df3390779d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c609f2-f4f5-4313-980f-4e109c54adce', 'volume_name': 'volume-25c609f2-f4f5-4313-980f-4e109c54adce', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a46bc2-ed11-4b27-b58a-2038f03e7992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a46bc2-ed11-4b27-b58a-2038f03e7992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269cc337-7360-4577-8c73-e76c29620b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:28 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Volume 25c609f2-f4f5-4313-980f-4e109c54adce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c609f2-f4f5-4313-980f-4e109c54adce', 'volume_size': 1} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:28 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-4a1ac57f-be14-401a-8f38-912b9fda3890 req-0d5ecf53-85a8-4f13-8bfe-1bd7836d2618 tempest-TestServerVolumeAttachmentScenario-1849281685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5109db90-06fd-4823-8ba8-e47b573dc89f" returned: 0 in 1.084s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-4a1ac57f-be14-401a-8f38-912b9fda3890 req-0d5ecf53-85a8-4f13-8bfe-1bd7836d2618 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.120s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.024s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1959431765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c609f2-f4f5-4313-980f-4e109c54adce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32e26622f0cf4114bd8b41ae4ffef805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:50:29Z,use_quota=True,user_id='7efd22b19d224d3eb255b7c5a40ec420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Creating volume 25c609f2-f4f5-4313-980f-4e109c54adce {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:50:28 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-25c609f2-f4f5-4313-980f-4e109c54adce 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:28 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-25c609f2-f4f5-4313-980f-4e109c54adce 1073741824 Jul 08 02:50:28 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-4a1ac57f-be14-401a-8f38-912b9fda3890 req-0d5ecf53-85a8-4f13-8bfe-1bd7836d2618 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-5109db90-06fd-4823-8ba8-e47b573dc89f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7091a842-d601-44f0-b1fe-88a8964f5304', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:50:28 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-4a1ac57f-be14-401a-8f38-912b9fda3890 req-0d5ecf53-85a8-4f13-8bfe-1bd7836d2618 tempest-TestServerVolumeAttachmentScenario-1849281685 None] attachment_update completed successfully. Jul 08 02:50:29 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-25c609f2-f4f5-4313-980f-4e109c54adce 1073741824" returned: 0 in 1.009s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-25c609f2-f4f5-4313-980f-4e109c54adce {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:29 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-25c609f2-f4f5-4313-980f-4e109c54adce Jul 08 02:50:29 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:30 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-25c609f2-f4f5-4313-980f-4e109c54adce" returned: 0 in 0.719s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:50:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269cc337-7360-4577-8c73-e76c29620b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c609f2-f4f5-4313-980f-4e109c54adce', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069f27eb-e6cb-49dd-8363-99aac4d1c92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:30 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Volume volume-25c609f2-f4f5-4313-980f-4e109c54adce (25c609f2-f4f5-4313-980f-4e109c54adce): created successfully Jul 08 02:50:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069f27eb-e6cb-49dd-8363-99aac4d1c92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:30 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Flow 'volume_create_manager' (bdad4407-5b28-46bf-9ea3-f5b42ae0ce37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:50:30 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-8deb64b3-18d3-4b91-ad56-0f290799f534 tempest-VolumesListTestJSON-1105425353 None] Created volume successfully. Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Flow 'volume_create_manager' (d7445d29-0c07-4e30-a375-a942e331436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6458b334-6fba-4b56-99a0-6c8a8fe451b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6458b334-6fba-4b56-99a0-6c8a8fe451b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1573427604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed729e5-44b9-4e0b-b641-a25b105bcc5f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32e26622f0cf4114bd8b41ae4ffef805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:50:32Z,use_quota=True,user_id='7efd22b19d224d3eb255b7c5a40ec420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37be128d-9a91-47a0-99bc-18f4061c2681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37be128d-9a91-47a0-99bc-18f4061c2681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28e9eb2-4ae3-448c-8f13-65944c4cd679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28e9eb2-4ae3-448c-8f13-65944c4cd679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed729e5-44b9-4e0b-b641-a25b105bcc5f', 'volume_name': 'volume-eed729e5-44b9-4e0b-b641-a25b105bcc5f', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd13cf68-8721-4564-be77-d42c2fa05232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd13cf68-8721-4564-be77-d42c2fa05232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506dcdec-fe76-4df8-a2d8-329ff480ad9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:32 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Volume eed729e5-44b9-4e0b-b641-a25b105bcc5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed729e5-44b9-4e0b-b641-a25b105bcc5f', 'volume_size': 1} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1573427604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed729e5-44b9-4e0b-b641-a25b105bcc5f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32e26622f0cf4114bd8b41ae4ffef805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:50:32Z,use_quota=True,user_id='7efd22b19d224d3eb255b7c5a40ec420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Creating volume eed729e5-44b9-4e0b-b641-a25b105bcc5f {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:50:32 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:50:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eed729e5-44b9-4e0b-b641-a25b105bcc5f 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:32 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eed729e5-44b9-4e0b-b641-a25b105bcc5f 1073741824 Jul 08 02:50:32 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:33 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eed729e5-44b9-4e0b-b641-a25b105bcc5f 1073741824" returned: 0 in 1.081s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eed729e5-44b9-4e0b-b641-a25b105bcc5f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:33 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eed729e5-44b9-4e0b-b641-a25b105bcc5f Jul 08 02:50:33 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:34 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eed729e5-44b9-4e0b-b641-a25b105bcc5f" returned: 0 in 0.734s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:34 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:50:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506dcdec-fe76-4df8-a2d8-329ff480ad9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed729e5-44b9-4e0b-b641-a25b105bcc5f', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd59e50-0f2e-488a-b950-88a9b6667461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:50:34 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Volume volume-eed729e5-44b9-4e0b-b641-a25b105bcc5f (eed729e5-44b9-4e0b-b641-a25b105bcc5f): created successfully Jul 08 02:50:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd59e50-0f2e-488a-b950-88a9b6667461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:50:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Flow 'volume_create_manager' (d7445d29-0c07-4e30-a375-a942e331436f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:50:34 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-429c0cd7-9f5b-404f-be0c-b78817dc4afc tempest-VolumesListTestJSON-1105425353 None] Created volume successfully. Jul 08 02:50:37 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-0fcae644-e904-46e6-a42d-e43638697580 req-aec7fd51-4c71-4551-a46b-2c0f590bf097 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Terminate volume connection completed successfully. Jul 08 02:50:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-0fcae644-e904-46e6-a42d-e43638697580 req-aec7fd51-4c71-4551-a46b-2c0f590bf097 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Deleting attachment 7091a842-d601-44f0-b1fe-88a8964f5304. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:50:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Acquiring lock "cinder-eed729e5-44b9-4e0b-b641-a25b105bcc5f-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:50:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Lock "cinder-eed729e5-44b9-4e0b-b641-a25b105bcc5f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:50:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Acquiring lock "cinder-quobyte-eed729e5-44b9-4e0b-b641-a25b105bcc5f" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:50:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Lock "cinder-quobyte-eed729e5-44b9-4e0b-b641-a25b105bcc5f" acquired by "delete_volume" :: waited 0.033s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:50:38 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fd28a1-fe85-49a3-a9bb-6ae4aa763b6c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:50:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eed729e5-44b9-4e0b-b641-a25b105bcc5f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:38 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eed729e5-44b9-4e0b-b641-a25b105bcc5f Jul 08 02:50:38 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:38 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eed729e5-44b9-4e0b-b641-a25b105bcc5f" returned: 0 in 0.955s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eed729e5-44b9-4e0b-b641-a25b105bcc5f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:39 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eed729e5-44b9-4e0b-b641-a25b105bcc5f Jul 08 02:50:39 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:39 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eed729e5-44b9-4e0b-b641-a25b105bcc5f" returned: 0 in 0.725s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Lock "cinder-quobyte-eed729e5-44b9-4e0b-b641-a25b105bcc5f" released by "delete_volume" :: held 1.740s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:50:39 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Created reservations ['5de4c243-a3c7-4dc4-953a-cab344ac4f84', '30363b0b-c4ef-4294-b7fe-618712a08621', '22e5b7b4-0eab-487c-abd2-9e09be5279a8', 'f4084ab2-934a-44c4-b219-6f6e308a58b7'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:50:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:50:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:50:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:39 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:50:39 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:40 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Acquiring lock "cinder-25c609f2-f4f5-4313-980f-4e109c54adce-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:50:40 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Lock "cinder-25c609f2-f4f5-4313-980f-4e109c54adce-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:50:40 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Acquiring lock "cinder-quobyte-25c609f2-f4f5-4313-980f-4e109c54adce" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:50:40 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Lock "cinder-quobyte-25c609f2-f4f5-4313-980f-4e109c54adce" acquired by "delete_volume" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:50:40 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa971808-51eb-4424-9db0-8e9b4c3d23b7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:50:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-25c609f2-f4f5-4313-980f-4e109c54adce {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:40 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-25c609f2-f4f5-4313-980f-4e109c54adce Jul 08 02:50:40 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:40 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-764a95d7-4cec-40d2-851a-dd4affed3809 req-d3b141b1-83a9-4921-b1cd-86bc27d2cd22 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Terminate volume connection completed successfully. Jul 08 02:50:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-764a95d7-4cec-40d2-851a-dd4affed3809 req-d3b141b1-83a9-4921-b1cd-86bc27d2cd22 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Deleting attachment 6a112204-67a5-4bce-812f-0f5a3f265215. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:50:40 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.920s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:40 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:50:40 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Deleted volume successfully. Jul 08 02:50:40 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2e541ed6-8aa2-4244-aed9-12fe8d55b75d tempest-VolumesListTestJSON-1105425353 None] Lock "cinder-eed729e5-44b9-4e0b-b641-a25b105bcc5f-delete_volume" released by "delete_volume" :: held 2.969s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:50:41 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-25c609f2-f4f5-4313-980f-4e109c54adce" returned: 0 in 0.863s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-25c609f2-f4f5-4313-980f-4e109c54adce {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:41 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-25c609f2-f4f5-4313-980f-4e109c54adce Jul 08 02:50:41 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:41 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-25c609f2-f4f5-4313-980f-4e109c54adce" returned: 0 in 0.687s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:41 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Lock "cinder-quobyte-25c609f2-f4f5-4313-980f-4e109c54adce" released by "delete_volume" :: held 1.600s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:50:42 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Created reservations ['d765898d-7a2c-48f1-bd86-a303231da239', 'eb603b11-9cbb-4681-b5c3-389ed7a135ef', '1a336eb1-555b-4ade-8974-d3f5fbb4387b', 'c2d590d9-8015-4235-85d9-91421a5392c2'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:50:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:42 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:50:42 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:50:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:42 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:50:42 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Acquiring lock "cinder-1ac60dda-a9a8-4340-8361-8e12a919a12f-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:50:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Lock "cinder-1ac60dda-a9a8-4340-8361-8e12a919a12f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:50:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Acquiring lock "cinder-quobyte-1ac60dda-a9a8-4340-8361-8e12a919a12f" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:50:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Lock "cinder-quobyte-1ac60dda-a9a8-4340-8361-8e12a919a12f" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:50:42 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c93bbb9-cb72-4371-a0df-f61156c69bc6]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:50:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1ac60dda-a9a8-4340-8361-8e12a919a12f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:42 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1ac60dda-a9a8-4340-8361-8e12a919a12f Jul 08 02:50:42 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:42 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.819s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:42 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:50:42 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Deleted volume successfully. Jul 08 02:50:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ef787b6e-091d-4c23-a83f-78db3fee366b tempest-VolumesListTestJSON-1105425353 None] Lock "cinder-25c609f2-f4f5-4313-980f-4e109c54adce-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:50:43 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1ac60dda-a9a8-4340-8361-8e12a919a12f" returned: 0 in 0.906s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1ac60dda-a9a8-4340-8361-8e12a919a12f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:43 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1ac60dda-a9a8-4340-8361-8e12a919a12f Jul 08 02:50:43 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:44 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1ac60dda-a9a8-4340-8361-8e12a919a12f" returned: 0 in 0.725s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:44 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Lock "cinder-quobyte-1ac60dda-a9a8-4340-8361-8e12a919a12f" released by "delete_volume" :: held 1.690s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:50:44 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Created reservations ['7512d560-1464-4c53-868f-aacf3c90fff5', '7ec0aa07-8aaf-4936-9590-2b1e015783eb', '38fe2821-9281-457b-b552-5b00c1d19257', '3adc216b-f1db-4a96-8f0a-ded20915c91a'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:50:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:44 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:50:44 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:50:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:44 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:50:44 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:45 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.212s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:45 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:50:45 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Deleted volume successfully. Jul 08 02:50:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b26b262d-5a6e-4292-a069-d513cda922a4 tempest-VolumesListTestJSON-1105425353 None] Lock "cinder-1ac60dda-a9a8-4340-8361-8e12a919a12f-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:50:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:50:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:50:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:50:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:47 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:50:47 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:48 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.766s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:50:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:50:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:50:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:50:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Acquiring lock "cinder-5109db90-06fd-4823-8ba8-e47b573dc89f-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:50:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "cinder-5109db90-06fd-4823-8ba8-e47b573dc89f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:50:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Acquiring lock "cinder-quobyte-5109db90-06fd-4823-8ba8-e47b573dc89f" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:50:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "cinder-quobyte-5109db90-06fd-4823-8ba8-e47b573dc89f" acquired by "delete_volume" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:50:51 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[9654b4e6-d363-4025-a581-a8e1f288df0e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:50:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5109db90-06fd-4823-8ba8-e47b573dc89f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:51 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5109db90-06fd-4823-8ba8-e47b573dc89f Jul 08 02:50:51 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:51 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5109db90-06fd-4823-8ba8-e47b573dc89f" returned: 0 in 0.787s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5109db90-06fd-4823-8ba8-e47b573dc89f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:52 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5109db90-06fd-4823-8ba8-e47b573dc89f Jul 08 02:50:52 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:52 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5109db90-06fd-4823-8ba8-e47b573dc89f" returned: 0 in 0.746s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "cinder-quobyte-5109db90-06fd-4823-8ba8-e47b573dc89f" released by "delete_volume" :: held 1.588s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:50:52 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Created reservations ['862f1f9c-b525-4807-bf95-988a79f7740a', 'fea9fb10-8669-452e-834c-214388212572', '06e2397b-88cd-441f-9c4a-3adcac32a555', '6c5b6336-bb98-4d5e-9678-321470a66503'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:50:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:50:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:50:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:52 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:50:52 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Acquiring lock "cinder-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:50:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "cinder-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:50:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Acquiring lock "cinder-quobyte-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:50:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "cinder-quobyte-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea" acquired by "delete_volume" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:50:53 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0506e50b-6eca-499a-83e2-d5ad9965567c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:50:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:53 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.713s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:53 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:50:53 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Deleted volume successfully. Jul 08 02:50:53 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea Jul 08 02:50:53 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2ba24cca-c045-4dde-8222-b5bc6da576a4 tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "cinder-5109db90-06fd-4823-8ba8-e47b573dc89f-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:50:54 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea" returned: 0 in 0.887s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:54 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea Jul 08 02:50:54 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:55 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea" returned: 0 in 0.759s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "cinder-quobyte-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea" released by "delete_volume" :: held 1.703s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:50:55 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=60,cinder:INSERT=16,cinder:SELECT=51,cinder:DELETE=5 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:50:55 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=65,cinder:UPDATE=76,cinder:DELETE=6,cinder:INSERT=15 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:50:55 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Created reservations ['eba69f23-6d6b-4bc1-9fc1-c28f1bee1cb9', 'c23f0e9b-febf-48a5-a7f0-4f88040cd7cd', '1ffa232d-5ec9-447b-81e4-01c9e3d855ae', 'e3a4bd57-606a-4a38-878e-f2bef6792459'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:50:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:50:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:50:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:50:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:50:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:50:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:50:55 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:50:55 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:50:56 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Jul 08 02:50:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.916s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:50:56 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:50:56 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Deleted volume successfully. Jul 08 02:50:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-87362fdc-92f9-4554-8e10-59feace2e6bc tempest-TestServerVolumeAttachmentScenario-1849281685 None] Lock "cinder-ab3189de-f0c4-4ba2-8e2d-1e39514fdaea-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Flow 'volume_create_manager' (e434f3a7-21c2-4704-98b3-6ae417575a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e385196-8ae6-4a7c-aacf-dd0ce8e347d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e385196-8ae6-4a7c-aacf-dd0ce8e347d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1245555865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93015701-0cc9-4b99-b9cb-0130d5bc5f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9365234df8f4299bc36b606270a8ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:00Z,use_quota=True,user_id='d31f1c5ec1644ba1a4ffc36044a5431d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9306e419-5577-4dce-b75a-a9e8ba1ab3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9306e419-5577-4dce-b75a-a9e8ba1ab3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514891e5-63ab-47e0-9ab7-c4db6b25d63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514891e5-63ab-47e0-9ab7-c4db6b25d63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93015701-0cc9-4b99-b9cb-0130d5bc5f6f', 'volume_name': 'volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d929e5-2131-4f8a-84e2-dede7501ec48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d929e5-2131-4f8a-84e2-dede7501ec48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d0e19f-9525-4007-8bdc-ef420787dce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:00 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Volume 93015701-0cc9-4b99-b9cb-0130d5bc5f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f', 'volume_size': 1} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1245555865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93015701-0cc9-4b99-b9cb-0130d5bc5f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9365234df8f4299bc36b606270a8ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:00Z,use_quota=True,user_id='d31f1c5ec1644ba1a4ffc36044a5431d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Creating volume 93015701-0cc9-4b99-b9cb-0130d5bc5f6f {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:51:00 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:51:00 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f 1073741824 Jul 08 02:51:00 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Flow 'volume_create_manager' (0d827ea3-5002-4037-953d-e6371cb233cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca449054-afb9-49ec-b9ae-b929dc2b3bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca449054-afb9-49ec-b9ae-b929dc2b3bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1983770348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c10936-7835-43c0-a866-002ea6e3367e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0308d6c4d044fdab3300afb3b37fbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:00Z,use_quota=True,user_id='154fa7c163fb48fda2c5a7aad8e392b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c459e8b5-5522-48b0-a797-c27071fdc280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c459e8b5-5522-48b0-a797-c27071fdc280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3424b755-3bef-4782-9ec5-e764b588c9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3424b755-3bef-4782-9ec5-e764b588c9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c10936-7835-43c0-a866-002ea6e3367e', 'volume_name': 'volume-30c10936-7835-43c0-a866-002ea6e3367e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ceacbb-752b-4dde-be40-0d184aa9b78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ceacbb-752b-4dde-be40-0d184aa9b78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c23cbb0-9fd2-4ff6-80be-419ac82c4440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:00 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Volume 30c10936-7835-43c0-a866-002ea6e3367e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c10936-7835-43c0-a866-002ea6e3367e', 'volume_size': 1} Jul 08 02:51:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:01 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f 1073741824" returned: 0 in 0.903s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:01 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f Jul 08 02:51:01 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:01 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f" returned: 0 in 0.712s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.542s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1983770348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c10936-7835-43c0-a866-002ea6e3367e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0308d6c4d044fdab3300afb3b37fbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:00Z,use_quota=True,user_id='154fa7c163fb48fda2c5a7aad8e392b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Creating volume 30c10936-7835-43c0-a866-002ea6e3367e {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:51:02 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:02 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e 1073741824 Jul 08 02:51:02 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d0e19f-9525-4007-8bdc-ef420787dce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7448489a-7def-48cd-84cd-f725dc712a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:02 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Volume volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f (93015701-0cc9-4b99-b9cb-0130d5bc5f6f): created successfully Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7448489a-7def-48cd-84cd-f725dc712a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Flow 'volume_create_manager' (e434f3a7-21c2-4704-98b3-6ae417575a11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:02 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-39b35846-b94f-40d2-8fc3-6921b8afca6f tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Created volume successfully. Jul 08 02:51:03 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e 1073741824" returned: 0 in 0.983s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:03 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e Jul 08 02:51:03 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:03 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e" returned: 0 in 0.743s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:51:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c23cbb0-9fd2-4ff6-80be-419ac82c4440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c10936-7835-43c0-a866-002ea6e3367e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f072ef-db6a-45ed-b01c-b17758a92c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:03 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Volume volume-30c10936-7835-43c0-a866-002ea6e3367e (30c10936-7835-43c0-a866-002ea6e3367e): created successfully Jul 08 02:51:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f072ef-db6a-45ed-b01c-b17758a92c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Flow 'volume_create_manager' (0d827ea3-5002-4037-953d-e6371cb233cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:03 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-70d90878-397f-40af-8004-eb6e33e875f3 tempest-VolumesSnapshotTestJSON-606300463 None] Created volume successfully. Jul 08 02:51:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] Creating offline snapshot 6ae5522d-c5b9-4608-85ca-ca742841e84f of volume 30c10936-7835-43c0-a866-002ea6e3367e {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:51:04 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13b8d0a-4113-406b-9098-906b0059b094]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:04 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e Jul 08 02:51:04 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:05 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e" returned: 0 in 0.850s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:05 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f 1G Jul 08 02:51:05 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:06 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f 1G" returned: 0 in 0.886s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30c10936-7835-43c0-a866-002ea6e3367e -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:06 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30c10936-7835-43c0-a866-002ea6e3367e -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f Jul 08 02:51:06 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-8eff4b97-bf06-497a-b190-8713e66d107f req-63333880-9453-4b02-ada6-0b5d9327a76c tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:06 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:51:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Flow 'volume_create_manager' (75d3104b-edfb-431b-9dd9-a4593df5c7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1055f88-4535-4775-96f8-02b93ebc061d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1055f88-4535-4775-96f8-02b93ebc061d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-51357189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203f86fb-53be-445e-80d2-200a0ff68173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12468925cf947cd8989f005abe747f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:07Z,use_quota=True,user_id='0e1279aec6514fdb8e22ff32f6c20c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25d4ecf-07c8-4255-a907-14bc47065675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25d4ecf-07c8-4255-a907-14bc47065675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8638dbd-f9fe-4936-baf3-78fe138c6f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8638dbd-f9fe-4936-baf3-78fe138c6f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '203f86fb-53be-445e-80d2-200a0ff68173', 'volume_name': 'volume-203f86fb-53be-445e-80d2-200a0ff68173', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9a72ee-4034-4b1e-b40f-30ad70d6cb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9a72ee-4034-4b1e-b40f-30ad70d6cb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607fd40c-87af-47eb-9945-444df434d6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:07 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Volume 203f86fb-53be-445e-80d2-200a0ff68173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-203f86fb-53be-445e-80d2-200a0ff68173', 'volume_size': 1} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:07 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30c10936-7835-43c0-a866-002ea6e3367e -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f" returned: 0 in 0.767s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:07 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f is being set with open permissions: ugo+rw Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:07 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f Jul 08 02:51:07 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Flow 'volume_create_manager' (01af4902-1c07-45ea-bad6-0bd53214729a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84b9d5a-90b7-4882-8ee2-a1de75f2d833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84b9d5a-90b7-4882-8ee2-a1de75f2d833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-731964884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4b2a43-a4c5-4ed0-879e-36d58b220128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12468925cf947cd8989f005abe747f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:07Z,use_quota=True,user_id='0e1279aec6514fdb8e22ff32f6c20c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242cc464-3273-4dee-896c-6c25a3ba8d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242cc464-3273-4dee-896c-6c25a3ba8d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816859ba-475b-4871-9398-022fc373b0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816859ba-475b-4871-9398-022fc373b0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4b2a43-a4c5-4ed0-879e-36d58b220128', 'volume_name': 'volume-2c4b2a43-a4c5-4ed0-879e-36d58b220128', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a27d892-a449-4659-bc06-fadfd1111566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a27d892-a449-4659-bc06-fadfd1111566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859b29ff-1bc5-426e-a794-2929483f9de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:07 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Volume 2c4b2a43-a4c5-4ed0-879e-36d58b220128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4b2a43-a4c5-4ed0-879e-36d58b220128', 'volume_size': 1} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Flow 'volume_create_manager' (7f9fe7fa-c7cc-4d3f-a4d3-3b4a8ccda1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (939bb301-b27b-4705-beee-96e43d4ea46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (939bb301-b27b-4705-beee-96e43d4ea46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-36033141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05037698-b200-4aa4-b276-8f81852e2f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12468925cf947cd8989f005abe747f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:08Z,use_quota=True,user_id='0e1279aec6514fdb8e22ff32f6c20c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebed18e-5341-4809-a14e-ff1f44bb2cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebed18e-5341-4809-a14e-ff1f44bb2cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64316362-dd05-4b1c-931d-fffb53e5abcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64316362-dd05-4b1c-931d-fffb53e5abcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05037698-b200-4aa4-b276-8f81852e2f98', 'volume_name': 'volume-05037698-b200-4aa4-b276-8f81852e2f98', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2240f746-69ec-4ef2-a5b7-81b68d88fdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2240f746-69ec-4ef2-a5b7-81b68d88fdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b5b40c-b7e1-4dc5-ae73-27b00c0c301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:07 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Volume 05037698-b200-4aa4-b276-8f81852e2f98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05037698-b200-4aa4-b276-8f81852e2f98', 'volume_size': 1} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:07 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f" returned: 0 in 0.747s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:08 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.info Jul 08 02:51:08 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Flow 'volume_create_manager' (a6163ae9-ab21-4dc7-9b87-8d1abf0cde8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde58401-d064-4b89-b91e-7a6173e2390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde58401-d064-4b89-b91e-7a6173e2390c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-287411128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3def3446-5143-4384-aab4-6134f7d941d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12468925cf947cd8989f005abe747f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:08Z,use_quota=True,user_id='0e1279aec6514fdb8e22ff32f6c20c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4fc869-ae6d-4635-806a-2085c0c5d587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4fc869-ae6d-4635-806a-2085c0c5d587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f11358c-3684-40ab-90ec-d641e233cdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f11358c-3684-40ab-90ec-d641e233cdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3def3446-5143-4384-aab4-6134f7d941d7', 'volume_name': 'volume-3def3446-5143-4384-aab4-6134f7d941d7', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5d9823-8f81-4094-979d-9e81bfbeef89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5d9823-8f81-4094-979d-9e81bfbeef89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b621e74-eeca-4135-b15c-da919fcae2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:08 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Volume 3def3446-5143-4384-aab4-6134f7d941d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3def3446-5143-4384-aab4-6134f7d941d7', 'volume_size': 1} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Flow 'volume_create_manager' (84d085ec-105d-4722-9fde-12ab6e16aa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f412f619-23eb-4fd0-b1c7-a508173fb3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f412f619-23eb-4fd0-b1c7-a508173fb3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1736886665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb4c5e2-b913-436a-acf3-b04030f8677e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12468925cf947cd8989f005abe747f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:08Z,use_quota=True,user_id='0e1279aec6514fdb8e22ff32f6c20c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5008f1-94a4-4bf4-aef8-4229a0bf5675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5008f1-94a4-4bf4-aef8-4229a0bf5675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ac6c4f-f578-4db6-bfd5-bfd898b73082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ac6c4f-f578-4db6-bfd5-bfd898b73082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eb4c5e2-b913-436a-acf3-b04030f8677e', 'volume_name': 'volume-8eb4c5e2-b913-436a-acf3-b04030f8677e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3acbbcd-0eb6-4e25-9183-d6179d3a19c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3acbbcd-0eb6-4e25-9183-d6179d3a19c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8c49a8-0b49-408b-93d2-626c303003cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:08 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Volume 8eb4c5e2-b913-436a-acf3-b04030f8677e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eb4c5e2-b913-436a-acf3-b04030f8677e', 'volume_size': 1} Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:08 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.info" returned: 0 in 0.684s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:08 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.info is being set with open permissions: ugo+rw Jul 08 02:51:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:08 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.info Jul 08 02:51:08 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:09 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.info" returned: 0 in 0.673s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.715s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-8eff4b97-bf06-497a-b190-8713e66d107f req-63333880-9453-4b02-ada6-0b5d9327a76c tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.709s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:09 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd163a0-2b42-4677-a2f7-67c51472fad0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-8eff4b97-bf06-497a-b190-8713e66d107f req-63333880-9453-4b02-ada6-0b5d9327a76c tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:09 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-75e753b0-2129-4e71-8323-c60defaf15e2 tempest-VolumesSnapshotTestJSON-606300463 None] Create snapshot completed successfully Jul 08 02:51:09 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f Jul 08 02:51:09 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-6ae5522d-c5b9-4608-85ca-ca742841e84f-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-6ae5522d-c5b9-4608-85ca-ca742841e84f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-quobyte-30c10936-7835-43c0-a866-002ea6e3367e" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:10 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-8eff4b97-bf06-497a-b190-8713e66d107f req-63333880-9453-4b02-ada6-0b5d9327a76c tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f" returned: 0 in 0.807s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-8eff4b97-bf06-497a-b190-8713e66d107f req-63333880-9453-4b02-ada6-0b5d9327a76c tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.831s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.174s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-51357189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203f86fb-53be-445e-80d2-200a0ff68173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12468925cf947cd8989f005abe747f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:07Z,use_quota=True,user_id='0e1279aec6514fdb8e22ff32f6c20c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Creating volume 203f86fb-53be-445e-80d2-200a0ff68173 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:51:10 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-203f86fb-53be-445e-80d2-200a0ff68173 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-30c10936-7835-43c0-a866-002ea6e3367e" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-quobyte-6ae5522d-c5b9-4608-85ca-ca742841e84f" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:10 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-203f86fb-53be-445e-80d2-200a0ff68173 1073741824 Jul 08 02:51:10 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-6ae5522d-c5b9-4608-85ca-ca742841e84f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Deleting offline snapshot 6ae5522d-c5b9-4608-85ca-ca742841e84f of volume 30c10936-7835-43c0-a866-002ea6e3367e {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] snapshot_file for this snap is: volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-8eff4b97-bf06-497a-b190-8713e66d107f req-63333880-9453-4b02-ada6-0b5d9327a76c tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5edbdd34-bbaf-44c0-a543-9ee20c37b6fc', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[620ac68d-68cd-443a-8f5e-b471aee2040f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:10 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-8eff4b97-bf06-497a-b190-8713e66d107f req-63333880-9453-4b02-ada6-0b5d9327a76c tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] attachment_update completed successfully. Jul 08 02:51:10 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f Jul 08 02:51:10 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:11 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f" returned: 0 in 0.844s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30c10936-7835-43c0-a866-002ea6e3367e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:51:11 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-203f86fb-53be-445e-80d2-200a0ff68173 1073741824" returned: 0 in 0.967s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10cab27-173f-4e78-a77c-0f998c1969b7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-203f86fb-53be-445e-80d2-200a0ff68173 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:11 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-203f86fb-53be-445e-80d2-200a0ff68173 Jul 08 02:51:11 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:11 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e Jul 08 02:51:11 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:11 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-203f86fb-53be-445e-80d2-200a0ff68173" returned: 0 in 0.683s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.533s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-731964884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4b2a43-a4c5-4ed0-879e-36d58b220128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12468925cf947cd8989f005abe747f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:07Z,use_quota=True,user_id='0e1279aec6514fdb8e22ff32f6c20c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Creating volume 2c4b2a43-a4c5-4ed0-879e-36d58b220128 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:51:11 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4b2a43-a4c5-4ed0-879e-36d58b220128 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:11 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4b2a43-a4c5-4ed0-879e-36d58b220128 1073741824 Jul 08 02:51:11 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607fd40c-87af-47eb-9945-444df434d6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-203f86fb-53be-445e-80d2-200a0ff68173', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2092a58-4586-4f27-b76b-352584c7d4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:12 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Volume volume-203f86fb-53be-445e-80d2-200a0ff68173 (203f86fb-53be-445e-80d2-200a0ff68173): created successfully Jul 08 02:51:12 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2092a58-4586-4f27-b76b-352584c7d4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:12 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Flow 'volume_create_manager' (75d3104b-edfb-431b-9dd9-a4593df5c7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:12 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b7a6c8a5-f49b-4bef-8af7-ebedc9bceed5 tempest-CreateVolumesFromImageTest-431818434 None] Created volume successfully. Jul 08 02:51:12 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e" returned: 0 in 0.826s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:12 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f Jul 08 02:51:12 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:12 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:12 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4b2a43-a4c5-4ed0-879e-36d58b220128 1073741824" returned: 0 in 0.919s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f" returned: 0 in 0.833s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:12 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f Jul 08 02:51:12 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4b2a43-a4c5-4ed0-879e-36d58b220128 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:12 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4b2a43-a4c5-4ed0-879e-36d58b220128 Jul 08 02:51:12 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:13 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e.6ae5522d-c5b9-4608-85ca-ca742841e84f" returned: 0 in 0.688s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:13 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4b2a43-a4c5-4ed0-879e-36d58b220128" returned: 0 in 0.657s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.797s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-36033141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05037698-b200-4aa4-b276-8f81852e2f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12468925cf947cd8989f005abe747f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:08Z,use_quota=True,user_id='0e1279aec6514fdb8e22ff32f6c20c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Creating volume 05037698-b200-4aa4-b276-8f81852e2f98 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:51:13 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-05037698-b200-4aa4-b276-8f81852e2f98 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:13 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-05037698-b200-4aa4-b276-8f81852e2f98 1073741824 Jul 08 02:51:13 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-6ae5522d-c5b9-4608-85ca-ca742841e84f" released by "_delete_snapshot" :: held 3.362s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859b29ff-1bc5-426e-a794-2929483f9de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4b2a43-a4c5-4ed0-879e-36d58b220128', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20379690-8ebd-41f2-9205-62e14b080bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-30c10936-7835-43c0-a866-002ea6e3367e" released by "delete_snapshot" :: held 3.409s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:13 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Volume volume-2c4b2a43-a4c5-4ed0-879e-36d58b220128 (2c4b2a43-a4c5-4ed0-879e-36d58b220128): created successfully Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20379690-8ebd-41f2-9205-62e14b080bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Flow 'volume_create_manager' (01af4902-1c07-45ea-bad6-0bd53214729a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:13 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-49a154ea-312d-4db7-956f-fd55c76773cb tempest-CreateVolumesFromImageTest-431818434 None] Created volume successfully. Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Created reservations ['53da2bbc-f919-4973-9f19-278c92504f51', 'd4683b44-ae90-471e-b16c-d66c08e9c994', '1845f705-f137-4286-bbac-57bab9fb4f6c', '6b2953f7-0fea-43e1-9615-14404c2aa8f5'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:51:13 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Delete snapshot completed successfully. Jul 08 02:51:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5c500160-a50c-46c1-bd80-c87ceda8b978 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-6ae5522d-c5b9-4608-85ca-ca742841e84f-delete_snapshot" released by "delete_snapshot" :: held 3.676s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:14 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-05037698-b200-4aa4-b276-8f81852e2f98 1073741824" returned: 0 in 0.906s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-05037698-b200-4aa4-b276-8f81852e2f98 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:14 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-05037698-b200-4aa4-b276-8f81852e2f98 Jul 08 02:51:14 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Flow 'volume_create_manager' (b9c29e92-1a07-4f9f-b5d5-2887e3b22de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b793b951-b561-42ed-9e5e-a3a942987cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b793b951-b561-42ed-9e5e-a3a942987cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1060510946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc0c056-c344-452d-833b-26ad709388db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0308d6c4d044fdab3300afb3b37fbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:15Z,use_quota=True,user_id='154fa7c163fb48fda2c5a7aad8e392b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1bd44d0-af40-434a-b503-e194f9af6b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1bd44d0-af40-434a-b503-e194f9af6b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21bd9b75-237f-46a7-ac68-6e38a976178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21bd9b75-237f-46a7-ac68-6e38a976178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dc0c056-c344-452d-833b-26ad709388db', 'volume_name': 'volume-9dc0c056-c344-452d-833b-26ad709388db', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3648ccf7-d8cd-495e-b268-c65915dbf389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3648ccf7-d8cd-495e-b268-c65915dbf389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206e4926-9c77-4328-8d71-af14e8087870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:15 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Volume 9dc0c056-c344-452d-833b-26ad709388db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dc0c056-c344-452d-833b-26ad709388db', 'volume_size': 1} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:15 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-05037698-b200-4aa4-b276-8f81852e2f98" returned: 0 in 0.724s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.108s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-287411128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3def3446-5143-4384-aab4-6134f7d941d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12468925cf947cd8989f005abe747f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:08Z,use_quota=True,user_id='0e1279aec6514fdb8e22ff32f6c20c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Creating volume 3def3446-5143-4384-aab4-6134f7d941d7 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:51:15 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3def3446-5143-4384-aab4-6134f7d941d7 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b5b40c-b7e1-4dc5-ae73-27b00c0c301e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05037698-b200-4aa4-b276-8f81852e2f98', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:15 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3def3446-5143-4384-aab4-6134f7d941d7 1073741824 Jul 08 02:51:15 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dba76f2-7acf-4d01-8b96-7bfbb99cbc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:15 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Volume volume-05037698-b200-4aa4-b276-8f81852e2f98 (05037698-b200-4aa4-b276-8f81852e2f98): created successfully Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dba76f2-7acf-4d01-8b96-7bfbb99cbc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Flow 'volume_create_manager' (7f9fe7fa-c7cc-4d3f-a4d3-3b4a8ccda1ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:15 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-62867c6d-3a84-458e-aa66-86f2d8c16913 tempest-CreateVolumesFromImageTest-431818434 None] Created volume successfully. Jul 08 02:51:16 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3def3446-5143-4384-aab4-6134f7d941d7 1073741824" returned: 0 in 0.931s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3def3446-5143-4384-aab4-6134f7d941d7 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:16 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3def3446-5143-4384-aab4-6134f7d941d7 Jul 08 02:51:16 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:16 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3def3446-5143-4384-aab4-6134f7d941d7" returned: 0 in 0.727s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:51:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.457s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1736886665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb4c5e2-b913-436a-acf3-b04030f8677e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12468925cf947cd8989f005abe747f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:08Z,use_quota=True,user_id='0e1279aec6514fdb8e22ff32f6c20c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:51:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Creating volume 8eb4c5e2-b913-436a-acf3-b04030f8677e {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:51:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:51:16 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:51:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8eb4c5e2-b913-436a-acf3-b04030f8677e 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b621e74-eeca-4135-b15c-da919fcae2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3def3446-5143-4384-aab4-6134f7d941d7', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:17 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8eb4c5e2-b913-436a-acf3-b04030f8677e 1073741824 Jul 08 02:51:17 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5468d60b-7a8c-4cca-a416-2d4b04231f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:17 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Volume volume-3def3446-5143-4384-aab4-6134f7d941d7 (3def3446-5143-4384-aab4-6134f7d941d7): created successfully Jul 08 02:51:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5468d60b-7a8c-4cca-a416-2d4b04231f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Flow 'volume_create_manager' (a6163ae9-ab21-4dc7-9b87-8d1abf0cde8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:17 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-079bef3b-341a-4cab-97f3-79556a519e76 tempest-CreateVolumesFromImageTest-431818434 None] Created volume successfully. Jul 08 02:51:17 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-a4ff9b26-96df-488c-bf73-ca1380c6e84c req-32563602-b7b2-44c3-aea9-b5e943e600bf tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Terminate volume connection completed successfully. Jul 08 02:51:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-a4ff9b26-96df-488c-bf73-ca1380c6e84c req-32563602-b7b2-44c3-aea9-b5e943e600bf tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Deleting attachment 5edbdd34-bbaf-44c0-a543-9ee20c37b6fc. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:51:17 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8eb4c5e2-b913-436a-acf3-b04030f8677e 1073741824" returned: 0 in 0.883s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8eb4c5e2-b913-436a-acf3-b04030f8677e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:17 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8eb4c5e2-b913-436a-acf3-b04030f8677e Jul 08 02:51:17 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:18 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8eb4c5e2-b913-436a-acf3-b04030f8677e" returned: 0 in 0.695s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.490s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1060510946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc0c056-c344-452d-833b-26ad709388db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0308d6c4d044fdab3300afb3b37fbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:15Z,use_quota=True,user_id='154fa7c163fb48fda2c5a7aad8e392b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Creating volume 9dc0c056-c344-452d-833b-26ad709388db {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:51:18 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8c49a8-0b49-408b-93d2-626c303003cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eb4c5e2-b913-436a-acf3-b04030f8677e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:18 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db 1073741824 Jul 08 02:51:18 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5a7954-49c3-42c0-a25e-1eb0598da85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:18 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Volume volume-8eb4c5e2-b913-436a-acf3-b04030f8677e (8eb4c5e2-b913-436a-acf3-b04030f8677e): created successfully Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5a7954-49c3-42c0-a25e-1eb0598da85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Flow 'volume_create_manager' (84d085ec-105d-4722-9fde-12ab6e16aa6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:18 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-4c0bd481-142f-423d-a914-4d60b5e37c7f tempest-CreateVolumesFromImageTest-431818434 None] Created volume successfully. Jul 08 02:51:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Acquiring lock "cinder-93015701-0cc9-4b99-b9cb-0130d5bc5f6f-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Lock "cinder-93015701-0cc9-4b99-b9cb-0130d5bc5f6f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Acquiring lock "cinder-quobyte-93015701-0cc9-4b99-b9cb-0130d5bc5f6f" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Lock "cinder-quobyte-93015701-0cc9-4b99-b9cb-0130d5bc5f6f" acquired by "delete_volume" :: waited 0.027s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:19 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4917317-dc9a-4596-8fe4-0786c1dcd7d7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "cinder-8eb4c5e2-b913-436a-acf3-b04030f8677e-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:19 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-8eb4c5e2-b913-436a-acf3-b04030f8677e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db 1073741824" returned: 0 in 0.952s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:19 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f Jul 08 02:51:19 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "cinder-quobyte-8eb4c5e2-b913-436a-acf3-b04030f8677e" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:19 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db Jul 08 02:51:19 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-quobyte-8eb4c5e2-b913-436a-acf3-b04030f8677e" acquired by "delete_volume" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:19 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[973c05b8-29db-4f23-8b71-ec77c98dc15d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8eb4c5e2-b913-436a-acf3-b04030f8677e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:19 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8eb4c5e2-b913-436a-acf3-b04030f8677e Jul 08 02:51:19 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:20 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f" returned: 0 in 0.858s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:20 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f Jul 08 02:51:20 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:20 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db" returned: 0 in 0.758s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:51:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206e4926-9c77-4328-8d71-af14e8087870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dc0c056-c344-452d-833b-26ad709388db', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f4ec4c-5a47-409f-9f86-1f9c36473ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:20 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Volume volume-9dc0c056-c344-452d-833b-26ad709388db (9dc0c056-c344-452d-833b-26ad709388db): created successfully Jul 08 02:51:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f4ec4c-5a47-409f-9f86-1f9c36473ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Flow 'volume_create_manager' (b9c29e92-1a07-4f9f-b5d5-2887e3b22de5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:20 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f6198a20-3f64-4328-85d8-aa39142bc862 tempest-VolumesSnapshotTestJSON-606300463 None] Created volume successfully. Jul 08 02:51:20 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8eb4c5e2-b913-436a-acf3-b04030f8677e" returned: 0 in 0.877s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8eb4c5e2-b913-436a-acf3-b04030f8677e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:20 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8eb4c5e2-b913-436a-acf3-b04030f8677e Jul 08 02:51:20 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:20 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-93015701-0cc9-4b99-b9cb-0130d5bc5f6f" returned: 0 in 0.654s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Lock "cinder-quobyte-93015701-0cc9-4b99-b9cb-0130d5bc5f6f" released by "delete_volume" :: held 1.572s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Created reservations ['ea61ea5b-2e04-465f-99a7-7dadf0291d1d', 'ac04828e-c045-4f9a-8393-fde7f1312a2d', '6221983f-4398-4397-baf7-7cd90665fc9b', 'b84f493f-15ab-407c-8e99-97bb94898256'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:21 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:51:21 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:21 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8eb4c5e2-b913-436a-acf3-b04030f8677e" returned: 0 in 0.696s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-quobyte-8eb4c5e2-b913-436a-acf3-b04030f8677e" released by "delete_volume" :: held 1.616s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Created reservations ['d2de0907-1a55-483a-b21f-affeda3cf4aa', 'ce70eba5-8baf-4bd9-9aff-d95180900be6', 'd1e397ff-498e-442d-ba75-51c7fe5fb77a', 'cf1e8237-dece-4a7b-9742-3b2f11d48d38'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:21 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:51:21 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "cinder-3def3446-5143-4384-aab4-6134f7d941d7-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-3def3446-5143-4384-aab4-6134f7d941d7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:21 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.843s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:21 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:51:21 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Deleted volume successfully. Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "cinder-quobyte-3def3446-5143-4384-aab4-6134f7d941d7" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] Creating offline snapshot d313882c-767a-4937-88b6-4caadecb6da1 of volume 9dc0c056-c344-452d-833b-26ad709388db {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-180f6766-4806-4f08-94d1-57dac3d0e75d tempest-TestServerVolumeAttachScenarioOldVersion-1350122875 None] Lock "cinder-93015701-0cc9-4b99-b9cb-0130d5bc5f6f-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-quobyte-3def3446-5143-4384-aab4-6134f7d941d7" acquired by "delete_volume" :: waited 0.042s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7695466c-b1bf-4a72-9feb-270aecd8afa5]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[068746c3-1709-4321-b8af-ee465acbeacf]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3def3446-5143-4384-aab4-6134f7d941d7 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:22 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db Jul 08 02:51:22 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:22 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3def3446-5143-4384-aab4-6134f7d941d7 Jul 08 02:51:22 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:22 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.963s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:51:22 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Deleted volume successfully. Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1418b2fe-3967-4768-98a4-d074c9ce0339 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-8eb4c5e2-b913-436a-acf3-b04030f8677e-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:22 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db" returned: 0 in 0.837s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:22 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 1G Jul 08 02:51:22 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:22 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3def3446-5143-4384-aab4-6134f7d941d7" returned: 0 in 0.863s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3def3446-5143-4384-aab4-6134f7d941d7 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:23 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3def3446-5143-4384-aab4-6134f7d941d7 Jul 08 02:51:23 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:23 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3def3446-5143-4384-aab4-6134f7d941d7" returned: 0 in 0.798s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-quobyte-3def3446-5143-4384-aab4-6134f7d941d7" released by "delete_volume" :: held 1.717s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:23 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Created reservations ['eea01d58-530c-417f-9237-272b2b3bfef1', '0fb525e1-27e5-4d94-88b4-3984ae1733ea', '4b4a93e2-4ec7-4b41-84f5-a249ae518135', '797cf2ee-57b2-4745-b21e-54545ccc3b4d'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:51:23 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 1G" returned: 0 in 1.007s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc0c056-c344-452d-833b-26ad709388db -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:23 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc0c056-c344-452d-833b-26ad709388db -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 Jul 08 02:51:23 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:24 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:51:24 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "cinder-05037698-b200-4aa4-b276-8f81852e2f98-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-05037698-b200-4aa4-b276-8f81852e2f98-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "cinder-quobyte-05037698-b200-4aa4-b276-8f81852e2f98" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-quobyte-05037698-b200-4aa4-b276-8f81852e2f98" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:24 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a9bfd1-b65c-42f0-91aa-0b4e3806eac6]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-05037698-b200-4aa4-b276-8f81852e2f98 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:24 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-05037698-b200-4aa4-b276-8f81852e2f98 Jul 08 02:51:24 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:24 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.870s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:24 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:51:24 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc0c056-c344-452d-833b-26ad709388db -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1" returned: 0 in 0.929s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:24 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 is being set with open permissions: ugo+rw Jul 08 02:51:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:24 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Deleted volume successfully. Jul 08 02:51:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-319c8bc0-2e43-4a7e-8cb2-25cd6734d214 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-3def3446-5143-4384-aab4-6134f7d941d7-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:24 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 Jul 08 02:51:24 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:25 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-05037698-b200-4aa4-b276-8f81852e2f98" returned: 0 in 0.988s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-05037698-b200-4aa4-b276-8f81852e2f98 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:25 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-05037698-b200-4aa4-b276-8f81852e2f98 Jul 08 02:51:25 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:25 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1" returned: 0 in 0.743s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:25 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.info Jul 08 02:51:25 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:26 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-05037698-b200-4aa4-b276-8f81852e2f98" returned: 0 in 0.708s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-quobyte-05037698-b200-4aa4-b276-8f81852e2f98" released by "delete_volume" :: held 1.752s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Created reservations ['bc2d3d98-137b-4b6b-92e3-e74c52d427b8', '0cda8932-7a07-47e9-afff-76d42caadc26', 'ecd8dcf2-88bc-47db-984e-b60798789334', 'e3f092d0-52e8-4422-a577-3b16305f58be'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:26 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:51:26 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:26 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.info" returned: 0 in 0.709s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:26 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.info is being set with open permissions: ugo+rw Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:26 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.info Jul 08 02:51:26 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "cinder-2c4b2a43-a4c5-4ed0-879e-36d58b220128-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-2c4b2a43-a4c5-4ed0-879e-36d58b220128-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "cinder-quobyte-2c4b2a43-a4c5-4ed0-879e-36d58b220128" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-quobyte-2c4b2a43-a4c5-4ed0-879e-36d58b220128" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dc0381-61f6-40c3-9198-8aa43a6d4c6f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4b2a43-a4c5-4ed0-879e-36d58b220128 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:26 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4b2a43-a4c5-4ed0-879e-36d58b220128 Jul 08 02:51:26 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:26 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.680s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:51:26 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Deleted volume successfully. Jul 08 02:51:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14743319-62ba-4622-b3fc-12163d28e881 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-05037698-b200-4aa4-b276-8f81852e2f98-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:27 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.info" returned: 0 in 0.748s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.107s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:27 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-17e1060c-86b1-4198-bc88-d040f25c77af tempest-VolumesSnapshotTestJSON-606300463 None] Create snapshot completed successfully Jul 08 02:51:27 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4b2a43-a4c5-4ed0-879e-36d58b220128" returned: 0 in 0.801s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4b2a43-a4c5-4ed0-879e-36d58b220128 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:27 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4b2a43-a4c5-4ed0-879e-36d58b220128 Jul 08 02:51:27 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:28 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4b2a43-a4c5-4ed0-879e-36d58b220128" returned: 0 in 0.659s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-quobyte-2c4b2a43-a4c5-4ed0-879e-36d58b220128" released by "delete_volume" :: held 1.507s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Created reservations ['67ae4a9a-5f23-4450-afde-ccf66b9e2a8d', '3933816b-6fdb-46ac-b328-31095f1b5a98', 'f47a4948-1de1-47b3-9788-f52f3b3b388c', 'f451168e-3f4d-4510-8811-0b24fb24c74d'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:28 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:51:28 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "cinder-203f86fb-53be-445e-80d2-200a0ff68173-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-203f86fb-53be-445e-80d2-200a0ff68173-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "cinder-quobyte-203f86fb-53be-445e-80d2-200a0ff68173" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-quobyte-203f86fb-53be-445e-80d2-200a0ff68173" acquired by "delete_volume" :: waited 0.031s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac39083-8a41-4fa1-8077-56e0b87c118d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-203f86fb-53be-445e-80d2-200a0ff68173 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Flow 'volume_create_manager' (7ed2fd8a-62b5-45d0-960e-ad943da22a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:28 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af62a48-32e3-4630-a17b-3028d04b92a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.706s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:51:28 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Deleted volume successfully. Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af62a48-32e3-4630-a17b-3028d04b92a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1269736058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8cdd92-ba65-4993-a248-7f36b89cc540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0308d6c4d044fdab3300afb3b37fbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d313882c-767a-4937-88b6-4caadecb6da1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:29Z,use_quota=True,user_id='154fa7c163fb48fda2c5a7aad8e392b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4958e0a0-81ef-49b6-acbf-4f41c29b79b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4958e0a0-81ef-49b6-acbf-4f41c29b79b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c03f968-6d55-403c-b3d4-7af25f802b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c03f968-6d55-403c-b3d4-7af25f802b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1f8cdd92-ba65-4993-a248-7f36b89cc540', 'volume_name': 'volume-1f8cdd92-ba65-4993-a248-7f36b89cc540', 'volume_size': 2, 'snapshot_id': 'd313882c-767a-4937-88b6-4caadecb6da1'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5667a190-f432-4a7a-91c9-346893fa8b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5667a190-f432-4a7a-91c9-346893fa8b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3779dc5b-bc79-4ca0-b567-4d1211e5e75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:28 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Volume 1f8cdd92-ba65-4993-a248-7f36b89cc540: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1f8cdd92-ba65-4993-a248-7f36b89cc540', 'volume_size': 2, 'snapshot_id': 'd313882c-767a-4937-88b6-4caadecb6da1'} Jul 08 02:51:28 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-203f86fb-53be-445e-80d2-200a0ff68173 Jul 08 02:51:28 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-quobyte-d313882c-767a-4937-88b6-4caadecb6da1-1f8cdd92-ba65-4993-a248-7f36b89cc540" by "_create_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b5d5d90f-cb78-4fa5-9f72-8da859d5df48 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-2c4b2a43-a4c5-4ed0-879e-36d58b220128-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-d313882c-767a-4937-88b6-4caadecb6da1-1f8cdd92-ba65-4993-a248-7f36b89cc540" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Creating volume 1f8cdd92-ba65-4993-a248-7f36b89cc540 from snapshot d313882c-767a-4937-88b6-4caadecb6da1 {{(pid=87238) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:51:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-quobyte-1f8cdd92-ba65-4993-a248-7f36b89cc540" by "_copy_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-1f8cdd92-ba65-4993-a248-7f36b89cc540" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] snapshot: d313882c-767a-4937-88b6-4caadecb6da1, volume: 1f8cdd92-ba65-4993-a248-7f36b89cc540, {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 02:51:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:29 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3a7a78-bb7f-481a-979f-f18e9d20ff2d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:29 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 Jul 08 02:51:29 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:29 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-203f86fb-53be-445e-80d2-200a0ff68173" returned: 0 in 0.984s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-203f86fb-53be-445e-80d2-200a0ff68173 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:29 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-203f86fb-53be-445e-80d2-200a0ff68173 Jul 08 02:51:29 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:30 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1" returned: 0 in 0.974s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc0c056-c344-452d-833b-26ad709388db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Creating direct copy from snapshot {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c5588a-72c8-4427-a0f4-1a7bf54008bd]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:30 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db Jul 08 02:51:30 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:30 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-203f86fb-53be-445e-80d2-200a0ff68173" returned: 0 in 0.736s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-quobyte-203f86fb-53be-445e-80d2-200a0ff68173" released by "delete_volume" :: held 1.775s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Created reservations ['734e4a4a-da82-4e7f-ab85-1d1b2e596ec3', '2251df35-c067-44ad-855f-3b4b7920146f', 'a710c758-3c33-449e-84c8-be48e6f51a80', 'b83bb82a-6ead-4ad1-a8c6-500523479a31'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:30 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:51:30 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:30 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db" returned: 0 in 0.864s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG cinder.utils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Path /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1f8cdd92-ba65-4993-a248-7f36b89cc540 not found in is_blk_device check {{(pid=87238) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 02:51:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1f8cdd92-ba65-4993-a248-7f36b89cc540 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:30 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1f8cdd92-ba65-4993-a248-7f36b89cc540 Jul 08 02:51:30 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:31 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.886s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:31 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:51:31 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Deleted volume successfully. Jul 08 02:51:31 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c2981f3f-8ad7-46eb-8492-87cf7d9d5ae4 tempest-CreateVolumesFromImageTest-431818434 None] Lock "cinder-203f86fb-53be-445e-80d2-200a0ff68173-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:37 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1f8cdd92-ba65-4993-a248-7f36b89cc540" returned: 0 in 6.317s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:37 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1626a35f-efee-4e1f-b3c5-c8868bec4664]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:37 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:51:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Flow 'volume_create_manager' (47f1b7a6-739d-4500-b1db-395cab469dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:37 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db Jul 08 02:51:37 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4970a80-d937-47b3-bb75-423fb5f4314e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4970a80-d937-47b3-bb75-423fb5f4314e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-46856299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b0d71e-5eeb-494d-a309-58e4fe0f8902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd18c53caccd49ccb3009d17dcc8a3bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:37Z,use_quota=True,user_id='0a279f67bdec457c9b1ac9b3690bf786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692e76f3-0abc-4f43-b0b2-c792a595bc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692e76f3-0abc-4f43-b0b2-c792a595bc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3383fd7-59c0-4961-a860-13892ecb2e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3383fd7-59c0-4961-a860-13892ecb2e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b0d71e-5eeb-494d-a309-58e4fe0f8902', 'volume_name': 'volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4bc7b66-677d-4cc2-ba3c-d3b96d488fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4bc7b66-677d-4cc2-ba3c-d3b96d488fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10143d66-f92c-44ab-aec4-1f0a69ec1272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:37 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Volume 91b0d71e-5eeb-494d-a309-58e4fe0f8902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902', 'volume_size': 1} Jul 08 02:51:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:38 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db" returned: 0 in 1.040s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:38 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db, size 1024.00 MB, duration 6.32 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1f8cdd92-ba65-4993-a248-7f36b89cc540 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:51:38 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Converted 1024.00 MB image at 162.07 MB/s Jul 08 02:51:38 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1f8cdd92-ba65-4993-a248-7f36b89cc540 is being set with open permissions: ugo+rw Jul 08 02:51:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1f8cdd92-ba65-4993-a248-7f36b89cc540 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:38 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1f8cdd92-ba65-4993-a248-7f36b89cc540 Jul 08 02:51:38 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:39 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1f8cdd92-ba65-4993-a248-7f36b89cc540" returned: 0 in 0.698s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-1f8cdd92-ba65-4993-a248-7f36b89cc540" released by "_copy_volume_from_snapshot" :: held 10.019s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-d313882c-767a-4937-88b6-4caadecb6da1-1f8cdd92-ba65-4993-a248-7f36b89cc540" released by "_create_volume_from_snapshot" :: held 10.061s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.088s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.595s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-46856299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b0d71e-5eeb-494d-a309-58e4fe0f8902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd18c53caccd49ccb3009d17dcc8a3bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:37Z,use_quota=True,user_id='0a279f67bdec457c9b1ac9b3690bf786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Creating volume 91b0d71e-5eeb-494d-a309-58e4fe0f8902 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:51:39 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:39 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 1073741824 Jul 08 02:51:39 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3779dc5b-bc79-4ca0-b567-4d1211e5e75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f8cdd92-ba65-4993-a248-7f36b89cc540', 'volume_size': 2, 'snapshot_id': 'd313882c-767a-4937-88b6-4caadecb6da1'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b645dbf9-f13c-4e84-a4ed-ce7cdabd983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:39 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Volume volume-1f8cdd92-ba65-4993-a248-7f36b89cc540 (1f8cdd92-ba65-4993-a248-7f36b89cc540): created successfully Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b645dbf9-f13c-4e84-a4ed-ce7cdabd983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Flow 'volume_create_manager' (7ed2fd8a-62b5-45d0-960e-ad943da22a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:39 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-418c6b6d-52f7-4c20-ada8-afbda7ec8e5b tempest-VolumesSnapshotTestJSON-606300463 None] Created volume successfully. Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-1f8cdd92-ba65-4993-a248-7f36b89cc540-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-1f8cdd92-ba65-4993-a248-7f36b89cc540-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-quobyte-1f8cdd92-ba65-4993-a248-7f36b89cc540" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-1f8cdd92-ba65-4993-a248-7f36b89cc540" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37a9b5a-62fa-4557-ae0b-ed4518091787]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1f8cdd92-ba65-4993-a248-7f36b89cc540 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:39 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1f8cdd92-ba65-4993-a248-7f36b89cc540 Jul 08 02:51:39 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:40 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 1073741824" returned: 0 in 0.985s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:40 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 Jul 08 02:51:40 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:40 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1f8cdd92-ba65-4993-a248-7f36b89cc540" returned: 0 in 0.930s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1f8cdd92-ba65-4993-a248-7f36b89cc540 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:40 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1f8cdd92-ba65-4993-a248-7f36b89cc540 Jul 08 02:51:40 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:40 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902" returned: 0 in 0.773s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:40 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:51:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10143d66-f92c-44ab-aec4-1f0a69ec1272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ffe812-aec8-424c-8157-1587ce76bb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:40 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Volume volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 (91b0d71e-5eeb-494d-a309-58e4fe0f8902): created successfully Jul 08 02:51:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ffe812-aec8-424c-8157-1587ce76bb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Flow 'volume_create_manager' (47f1b7a6-739d-4500-b1db-395cab469dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:40 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3b933120-d89d-4ac4-8536-47c90ae347f8 tempest-VolumeDependencyTests-518804102 None] Created volume successfully. Jul 08 02:51:41 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-1f8cdd92-ba65-4993-a248-7f36b89cc540" returned: 0 in 0.714s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:41 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-1f8cdd92-ba65-4993-a248-7f36b89cc540" released by "delete_volume" :: held 1.693s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:41 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Created reservations ['ebd0d8e0-34ca-4cd3-a161-7ec696bfefa9', 'c64346e8-6381-4f60-a18f-a5e4b64504d2', 'b3e98b9e-885e-4820-9dfd-311e3b812e43', 'd8ee0a0d-34aa-4e9a-8878-4239d343b5e0'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:51:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:41 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:51:41 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-d313882c-767a-4937-88b6-4caadecb6da1-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-d313882c-767a-4937-88b6-4caadecb6da1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-quobyte-9dc0c056-c344-452d-833b-26ad709388db" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-9dc0c056-c344-452d-833b-26ad709388db" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-quobyte-d313882c-767a-4937-88b6-4caadecb6da1" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-d313882c-767a-4937-88b6-4caadecb6da1" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Deleting offline snapshot d313882c-767a-4937-88b6-4caadecb6da1 of volume 9dc0c056-c344-452d-833b-26ad709388db {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] snapshot_file for this snap is: volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] Creating offline snapshot e06a4787-27c3-451e-b8ff-be9cea6a5376 of volume 91b0d71e-5eeb-494d-a309-58e4fe0f8902 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1387daa5-0a40-44a5-b95e-abb8f4fa9941]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[836b56e0-c7c3-4e57-a08f-298106a9d380]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:42 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 Jul 08 02:51:42 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:42 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 Jul 08 02:51:42 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:42 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.816s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:51:42 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Deleted volume successfully. Jul 08 02:51:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c8701762-f972-4d92-a2f6-fded01679c57 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-1f8cdd92-ba65-4993-a248-7f36b89cc540-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:43 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1" returned: 0 in 0.877s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc0c056-c344-452d-833b-26ad709388db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:51:43 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902" returned: 0 in 0.891s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:43 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[23eb7c3f-fc43-4da7-8706-c6dd09652758]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:43 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 1G Jul 08 02:51:43 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:43 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db Jul 08 02:51:43 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:44 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db" returned: 0 in 0.819s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:44 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 Jul 08 02:51:44 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:44 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 1G" returned: 0 in 0.892s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:44 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 Jul 08 02:51:44 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:44 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376" returned: 0 in 0.731s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:44 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 is being set with open permissions: ugo+rw Jul 08 02:51:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:44 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1" returned: 0 in 0.823s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:44 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 Jul 08 02:51:44 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:44 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1 Jul 08 02:51:44 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:45 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376" returned: 0 in 0.739s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:45 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db.d313882c-767a-4937-88b6-4caadecb6da1" returned: 0 in 0.723s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-d313882c-767a-4937-88b6-4caadecb6da1" released by "_delete_snapshot" :: held 3.412s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-9dc0c056-c344-452d-833b-26ad709388db" released by "delete_snapshot" :: held 3.452s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:45 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.info Jul 08 02:51:45 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:45 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Created reservations ['66c3f8be-c5c2-47cb-b318-f630c161e93e', '570fbcf5-f6b2-4005-9366-48ea909096ac', '756ea72c-3c29-472f-b5fe-94a49d082753', 'd4dfe825-5dbd-447d-aa80-87c4d6a5eccb'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:51:45 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Delete snapshot completed successfully. Jul 08 02:51:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-14e3ec1c-39b7-41a7-b88a-ba89ebdee924 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-d313882c-767a-4937-88b6-4caadecb6da1-delete_snapshot" released by "delete_snapshot" :: held 3.681s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:46 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.info" returned: 0 in 0.755s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:46 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.info is being set with open permissions: ugo+rw Jul 08 02:51:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:46 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.info Jul 08 02:51:46 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-9dc0c056-c344-452d-833b-26ad709388db-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-9dc0c056-c344-452d-833b-26ad709388db-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-quobyte-9dc0c056-c344-452d-833b-26ad709388db" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-9dc0c056-c344-452d-833b-26ad709388db" acquired by "delete_volume" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:46 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a970409-6306-491e-88c7-a8826f97b814]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:46 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db Jul 08 02:51:46 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:47 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.info" returned: 0 in 0.734s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.912s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:47 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ea30c289-c521-4a8e-80d9-a94b291a5fc2 tempest-VolumeDependencyTests-518804102 None] Create snapshot completed successfully Jul 08 02:51:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:51:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:47 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:51:47 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:47 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db" returned: 0 in 0.861s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:47 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db Jul 08 02:51:47 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Flow 'volume_create_manager' (fd75df20-26dc-488f-bc0a-4775418da548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c34f9b0-51d7-44e3-b8d0-7443ab381205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c34f9b0-51d7-44e3-b8d0-7443ab381205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-342311616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c423139d-91e3-4e51-aa0b-b4962c49a7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd18c53caccd49ccb3009d17dcc8a3bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e06a4787-27c3-451e-b8ff-be9cea6a5376,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:48Z,use_quota=True,user_id='0a279f67bdec457c9b1ac9b3690bf786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcece60-210d-4538-99de-9e66424d04b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcece60-210d-4538-99de-9e66424d04b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:48 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3d2889-e6e0-422f-8978-16d60729fb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3d2889-e6e0-422f-8978-16d60729fb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c423139d-91e3-4e51-aa0b-b4962c49a7f9', 'volume_name': 'volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9', 'volume_size': 1, 'snapshot_id': 'e06a4787-27c3-451e-b8ff-be9cea6a5376'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0f622f-89d3-4dc1-aa26-08313c181283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0f622f-89d3-4dc1-aa26-08313c181283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930082e3-468a-4696-a545-37bd7b498cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:48 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Volume c423139d-91e3-4e51-aa0b-b4962c49a7f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9', 'volume_size': 1, 'snapshot_id': 'e06a4787-27c3-451e-b8ff-be9cea6a5376'} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.976s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Acquiring lock "cinder-quobyte-e06a4787-27c3-451e-b8ff-be9cea6a5376-c423139d-91e3-4e51-aa0b-b4962c49a7f9" by "_create_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Lock "cinder-quobyte-e06a4787-27c3-451e-b8ff-be9cea6a5376-c423139d-91e3-4e51-aa0b-b4962c49a7f9" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Creating volume c423139d-91e3-4e51-aa0b-b4962c49a7f9 from snapshot e06a4787-27c3-451e-b8ff-be9cea6a5376 {{(pid=87238) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Acquiring lock "cinder-quobyte-c423139d-91e3-4e51-aa0b-b4962c49a7f9" by "_copy_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Lock "cinder-quobyte-c423139d-91e3-4e51-aa0b-b4962c49a7f9" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] snapshot: e06a4787-27c3-451e-b8ff-be9cea6a5376, volume: c423139d-91e3-4e51-aa0b-b4962c49a7f9, {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0a676c-b4d1-4e5a-91e5-273fb82939a7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:48 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9dc0c056-c344-452d-833b-26ad709388db" returned: 0 in 0.903s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-9dc0c056-c344-452d-833b-26ad709388db" released by "delete_volume" :: held 1.838s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Created reservations ['a3625fbc-85c7-4b01-8a89-92c06543053a', 'e9c1e21f-2cb6-4438-8d54-812b12244ecb', '630fcf18-8a13-4676-8c45-17a78cd28ee4', '43ca05af-3963-489c-ae00-9a50290185cc'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:51:48 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 Jul 08 02:51:48 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:48 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:51:48 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:49 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376" returned: 0 in 0.893s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Creating direct copy from snapshot {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[966285db-829b-405a-934d-6b13f2a151b5]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:49 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.876s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:49 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:51:49 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:49 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Deleted volume successfully. Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-71acd464-283c-4e36-9941-e908246be309 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-9dc0c056-c344-452d-833b-26ad709388db-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Flow 'volume_create_manager' (e85e5083-0a4f-450c-bd97-ebcd8d366b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df1292e-3479-43ad-b85e-57e867e87cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df1292e-3479-43ad-b85e-57e867e87cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1229586711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f8cccc-9f8b-4816-b627-765050ca762a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0308d6c4d044fdab3300afb3b37fbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:50Z,use_quota=True,user_id='154fa7c163fb48fda2c5a7aad8e392b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd19e265-e9a7-4b2d-918b-8a9870120ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd19e265-e9a7-4b2d-918b-8a9870120ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e149d3-baab-49f0-82ea-be27c01f54af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e149d3-baab-49f0-82ea-be27c01f54af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44f8cccc-9f8b-4816-b627-765050ca762a', 'volume_name': 'volume-44f8cccc-9f8b-4816-b627-765050ca762a', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5b4956-09a1-4ea8-bf7e-6415a723ed1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5b4956-09a1-4ea8-bf7e-6415a723ed1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b64392-f45b-4e1f-b960-8ae13ea8935f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:49 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Volume 44f8cccc-9f8b-4816-b627-765050ca762a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44f8cccc-9f8b-4816-b627-765050ca762a', 'volume_size': 1} Jul 08 02:51:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:50 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902" returned: 0 in 0.947s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:50 devstack cinder-volume[87238]: DEBUG cinder.utils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Path /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9 not found in is_blk_device check {{(pid=87238) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 02:51:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:50 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9 Jul 08 02:51:50 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:56 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9" returned: 0 in 6.064s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:56 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cb6e59-48e7-451e-ba9a-a6ef97de74be]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:56 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 Jul 08 02:51:56 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:57 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902" returned: 0 in 0.994s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:57 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:51:57 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Converted 1024.00 MB image at 168.82 MB/s Jul 08 02:51:57 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9 is being set with open permissions: ugo+rw Jul 08 02:51:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:57 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9 Jul 08 02:51:57 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:58 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9" returned: 0 in 0.733s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Lock "cinder-quobyte-c423139d-91e3-4e51-aa0b-b4962c49a7f9" released by "_copy_volume_from_snapshot" :: held 9.756s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Lock "cinder-quobyte-e06a4787-27c3-451e-b8ff-be9cea6a5376-c423139d-91e3-4e51-aa0b-b4962c49a7f9" released by "_create_volume_from_snapshot" :: held 9.793s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.825s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.448s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1229586711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f8cccc-9f8b-4816-b627-765050ca762a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0308d6c4d044fdab3300afb3b37fbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:51:50Z,use_quota=True,user_id='154fa7c163fb48fda2c5a7aad8e392b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Creating volume 44f8cccc-9f8b-4816-b627-765050ca762a {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:51:58 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=102,cinder:INSERT=24,cinder:UPDATE=110,cinder:DELETE=13 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:51:58 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a 1073741824 Jul 08 02:51:58 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:INSERT=32,cinder:UPDATE=129,cinder:SELECT=100,cinder:DELETE=9 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930082e3-468a-4696-a545-37bd7b498cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9', 'volume_size': 1, 'snapshot_id': 'e06a4787-27c3-451e-b8ff-be9cea6a5376'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d613f08-7ad3-4678-9601-064dca7a8c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:58 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Volume volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9 (c423139d-91e3-4e51-aa0b-b4962c49a7f9): created successfully Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d613f08-7ad3-4678-9601-064dca7a8c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Flow 'volume_create_manager' (fd75df20-26dc-488f-bc0a-4775418da548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:58 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b7de14f5-6177-4c91-b361-410a4adfd18b tempest-VolumeDependencyTests-518804102 None] Created volume successfully. Jul 08 02:51:59 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a 1073741824" returned: 0 in 0.940s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:59 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a Jul 08 02:51:59 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Acquiring lock "cinder-e06a4787-27c3-451e-b8ff-be9cea6a5376-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Lock "cinder-e06a4787-27c3-451e-b8ff-be9cea6a5376-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Acquiring lock "cinder-quobyte-91b0d71e-5eeb-494d-a309-58e4fe0f8902" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Lock "cinder-quobyte-91b0d71e-5eeb-494d-a309-58e4fe0f8902" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Acquiring lock "cinder-quobyte-e06a4787-27c3-451e-b8ff-be9cea6a5376" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Lock "cinder-quobyte-e06a4787-27c3-451e-b8ff-be9cea6a5376" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Deleting offline snapshot e06a4787-27c3-451e-b8ff-be9cea6a5376 of volume 91b0d71e-5eeb-494d-a309-58e4fe0f8902 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] snapshot_file for this snap is: volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d694139-167e-407f-af56-739b7200ccb1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:51:59 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 Jul 08 02:51:59 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:51:59 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a" returned: 0 in 0.773s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b64392-f45b-4e1f-b960-8ae13ea8935f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44f8cccc-9f8b-4816-b627-765050ca762a', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63151ebb-af92-42ed-b862-becffecee6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:51:59 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Volume volume-44f8cccc-9f8b-4816-b627-765050ca762a (44f8cccc-9f8b-4816-b627-765050ca762a): created successfully Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63151ebb-af92-42ed-b862-becffecee6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:51:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Flow 'volume_create_manager' (e85e5083-0a4f-450c-bd97-ebcd8d366b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:51:59 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-9f78c192-9884-419b-b806-cb320d5ca213 tempest-VolumesSnapshotTestJSON-606300463 None] Created volume successfully. Jul 08 02:52:00 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376" returned: 0 in 0.838s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:00 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:52:00 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1767014-fdbe-4585-9d6f-f4d0f5051b9f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:00 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 Jul 08 02:52:00 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:01 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902" returned: 0 in 0.787s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:01 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 Jul 08 02:52:01 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:52:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:52:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] Creating offline snapshot 639af041-a56b-4953-ae12-7fc82577eeec of volume 44f8cccc-9f8b-4816-b627-765050ca762a {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:52:01 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d67cbd-2ed9-4c4f-a29c-9a3e2b3d2c24]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:01 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a Jul 08 02:52:01 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:01 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376" returned: 0 in 0.780s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:01 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376 Jul 08 02:52:01 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:02 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a" returned: 0 in 0.815s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:02 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec 1G Jul 08 02:52:02 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:02 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902.e06a4787-27c3-451e-b8ff-be9cea6a5376" returned: 0 in 0.706s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Lock "cinder-quobyte-e06a4787-27c3-451e-b8ff-be9cea6a5376" released by "_delete_snapshot" :: held 3.245s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Lock "cinder-quobyte-91b0d71e-5eeb-494d-a309-58e4fe0f8902" released by "delete_snapshot" :: held 3.276s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:02 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Created reservations ['4071c1ea-f095-4b87-a8e6-40ba569ed78c', '7011794d-1257-45be-9885-6fc686471c1c', '1342881b-5180-4890-bee5-d75399fdb821', '7ae09127-f2f2-4e26-8a1f-38689cb8a7d3'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:52:02 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Delete snapshot completed successfully. Jul 08 02:52:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a7682e5e-4fa3-46cb-8082-1f9563ca626e tempest-VolumeDependencyTests-518804102 None] Lock "cinder-e06a4787-27c3-451e-b8ff-be9cea6a5376-delete_snapshot" released by "delete_snapshot" :: held 3.661s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:03 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec 1G" returned: 0 in 0.895s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44f8cccc-9f8b-4816-b627-765050ca762a -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:03 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44f8cccc-9f8b-4816-b627-765050ca762a -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec Jul 08 02:52:03 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:03 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Acquiring lock "cinder-91b0d71e-5eeb-494d-a309-58e4fe0f8902-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:52:03 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Lock "cinder-91b0d71e-5eeb-494d-a309-58e4fe0f8902-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:52:03 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Acquiring lock "cinder-quobyte-91b0d71e-5eeb-494d-a309-58e4fe0f8902" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:52:03 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Lock "cinder-quobyte-91b0d71e-5eeb-494d-a309-58e4fe0f8902" acquired by "delete_volume" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:52:03 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1c0d1b-7b37-4b92-8c45-7bca9060097d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:03 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44f8cccc-9f8b-4816-b627-765050ca762a -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec" returned: 0 in 0.814s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:03 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec is being set with open permissions: ugo+rw Jul 08 02:52:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:03 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 Jul 08 02:52:03 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:03 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec Jul 08 02:52:03 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:04 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec" returned: 0 in 0.780s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:04 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902" returned: 0 in 1.004s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:04 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902 Jul 08 02:52:04 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:04 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.info Jul 08 02:52:04 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:05 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-91b0d71e-5eeb-494d-a309-58e4fe0f8902" returned: 0 in 0.703s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Lock "cinder-quobyte-91b0d71e-5eeb-494d-a309-58e4fe0f8902" released by "delete_volume" :: held 1.797s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:05 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.info" returned: 0 in 0.772s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:05 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.info is being set with open permissions: ugo+rw Jul 08 02:52:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:05 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.info Jul 08 02:52:05 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:05 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Created reservations ['d320144c-576e-4b41-a206-6c1c6eda3d2e', '400f0622-fa34-44b5-90ef-f1e4e496d519', '466e513c-fb7e-462a-93d4-dc7b64277d5d', '90e35cb8-d8e9-4257-b789-3c85857776ba'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:52:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:52:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:52:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:52:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:52:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:52:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:05 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:52:05 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Acquiring lock "cinder-c423139d-91e3-4e51-aa0b-b4962c49a7f9-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:52:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Lock "cinder-c423139d-91e3-4e51-aa0b-b4962c49a7f9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:52:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Acquiring lock "cinder-quobyte-c423139d-91e3-4e51-aa0b-b4962c49a7f9" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:52:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Lock "cinder-quobyte-c423139d-91e3-4e51-aa0b-b4962c49a7f9" acquired by "delete_volume" :: waited 0.040s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:52:06 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecfbefe-6c30-4121-aafb-ed5d13118fb7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:06 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9 Jul 08 02:52:06 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:06 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.info" returned: 0 in 0.966s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.275s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:52:06 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-4e36f597-ff0a-4b54-8ede-6c41d7b88153 tempest-VolumesSnapshotTestJSON-606300463 None] Create snapshot completed successfully Jul 08 02:52:06 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.126s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:07 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:52:07 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Deleted volume successfully. Jul 08 02:52:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-264f1777-6c00-4f0c-87da-7066b04f6aa4 tempest-VolumeDependencyTests-518804102 None] Lock "cinder-91b0d71e-5eeb-494d-a309-58e4fe0f8902-delete_volume" released by "delete_volume" :: held 3.415s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:07 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9" returned: 0 in 0.928s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:07 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9 Jul 08 02:52:07 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:07 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:52:07 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c423139d-91e3-4e51-aa0b-b4962c49a7f9" returned: 0 in 0.733s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Lock "cinder-quobyte-c423139d-91e3-4e51-aa0b-b4962c49a7f9" released by "delete_volume" :: held 1.800s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Flow 'volume_create_manager' (8b3beb9a-38a8-4ce8-8f2b-db4b53e8c747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c3ba6f-aa7f-4bee-bdd1-2c1931442a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c3ba6f-aa7f-4bee-bdd1-2c1931442a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1757114430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c615d4-6df0-43a5-8708-6a5239519985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0308d6c4d044fdab3300afb3b37fbeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=639af041-a56b-4953-ae12-7fc82577eeec,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:52:08Z,use_quota=True,user_id='154fa7c163fb48fda2c5a7aad8e392b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087a59c9-63d7-4dea-8d94-e4cc2ce0c197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087a59c9-63d7-4dea-8d94-e4cc2ce0c197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c92383d-3f90-4b4d-b0e8-9c23d79aadc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c92383d-3f90-4b4d-b0e8-9c23d79aadc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '62c615d4-6df0-43a5-8708-6a5239519985', 'volume_name': 'volume-62c615d4-6df0-43a5-8708-6a5239519985', 'volume_size': 1, 'snapshot_id': '639af041-a56b-4953-ae12-7fc82577eeec'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d451bd-c451-4d96-a4b5-95c7aa25f6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d451bd-c451-4d96-a4b5-95c7aa25f6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a329cef0-71e0-4876-b021-e20cc96fe060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:52:08 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Volume 62c615d4-6df0-43a5-8708-6a5239519985: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-62c615d4-6df0-43a5-8708-6a5239519985', 'volume_size': 1, 'snapshot_id': '639af041-a56b-4953-ae12-7fc82577eeec'} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-quobyte-639af041-a56b-4953-ae12-7fc82577eeec-62c615d4-6df0-43a5-8708-6a5239519985" by "_create_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-639af041-a56b-4953-ae12-7fc82577eeec-62c615d4-6df0-43a5-8708-6a5239519985" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Creating volume 62c615d4-6df0-43a5-8708-6a5239519985 from snapshot 639af041-a56b-4953-ae12-7fc82577eeec {{(pid=87238) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-quobyte-62c615d4-6df0-43a5-8708-6a5239519985" by "_copy_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-62c615d4-6df0-43a5-8708-6a5239519985" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] snapshot: 639af041-a56b-4953-ae12-7fc82577eeec, volume: 62c615d4-6df0-43a5-8708-6a5239519985, {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Created reservations ['2c28af78-e7b7-4de3-9029-c9a01c1db7e1', '9b452a4a-6466-44e0-a60a-f7f5c31234ac', '8eb1277e-9383-4940-b535-85b19357f568', '46230dc1-0761-40e7-b5f7-5762efdd6bf9'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1048a0ea-268a-4435-a9b6-488c9fe294e9]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:52:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:08 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec Jul 08 02:52:08 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:08 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:52:08 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:09 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:09 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec" returned: 0 in 0.850s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44f8cccc-9f8b-4816-b627-765050ca762a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:52:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 02:52:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Creating direct copy from snapshot {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 02:52:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.757s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:09 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:52:09 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Deleted volume successfully. Jul 08 02:52:09 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b17bb7-47cb-4c6d-b689-f0328e338296]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:09 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b8772a27-349a-43a5-a07e-c09c25e317e4 tempest-VolumeDependencyTests-518804102 None] Lock "cinder-c423139d-91e3-4e51-aa0b-b4962c49a7f9-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:09 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a Jul 08 02:52:09 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:10 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a" returned: 0 in 0.883s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:10 devstack cinder-volume[87238]: DEBUG cinder.utils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Path /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-62c615d4-6df0-43a5-8708-6a5239519985 not found in is_blk_device check {{(pid=87238) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 02:52:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-62c615d4-6df0-43a5-8708-6a5239519985 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:10 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-62c615d4-6df0-43a5-8708-6a5239519985 Jul 08 02:52:10 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:16 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-62c615d4-6df0-43a5-8708-6a5239519985" returned: 0 in 6.099s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:16 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f93f698-7295-4cd9-b75e-2a101efff3d4]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:16 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a Jul 08 02:52:16 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:17 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a" returned: 0 in 1.058s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-62c615d4-6df0-43a5-8708-6a5239519985 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:52:17 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Converted 1024.00 MB image at 167.80 MB/s Jul 08 02:52:17 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-62c615d4-6df0-43a5-8708-6a5239519985 is being set with open permissions: ugo+rw Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-62c615d4-6df0-43a5-8708-6a5239519985 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:17 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-62c615d4-6df0-43a5-8708-6a5239519985 Jul 08 02:52:17 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Flow 'volume_create_manager' (fe858cf5-6de6-4a9a-ae15-ea80afa1557a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679f39ab-f64c-4b2b-848a-5200199cdc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679f39ab-f64c-4b2b-848a-5200199cdc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-925013704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ca2a13-5955-4352-aa77-36d7549ad123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd1815a8be64216a15d04ac8a042ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:52:17Z,use_quota=True,user_id='e9bed427fe094b58b50f09bdf98eca6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29180ead-fbf4-49cc-ad5d-3a41ca74d6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29180ead-fbf4-49cc-ad5d-3a41ca74d6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e50da96-f459-4ef8-83f6-eafb29317c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG cinder.image.glance [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Creating Keystone auth plugin from conf {{(pid=87238) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e50da96-f459-4ef8-83f6-eafb29317c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c8ca2a13-5955-4352-aa77-36d7549ad123', 'volume_name': 'volume-c8ca2a13-5955-4352-aa77-36d7549ad123', 'volume_size': 1, 'image_id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a21b7084cd94a8dbdfabbb9ed31db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'created_at': datetime.datetime(2026, 7, 8, 0, 29, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 29, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d652479-1a49-4785-9fa6-62d5f48b409f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:52:17 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b31479-4710-4751-b971-b632489e9258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b31479-4710-4751-b971-b632489e9258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7291cf0-d86d-41cd-8557-4e96c7682f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:52:17 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Volume c8ca2a13-5955-4352-aa77-36d7549ad123: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c8ca2a13-5955-4352-aa77-36d7549ad123', 'volume_size': 1, 'image_id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a21b7084cd94a8dbdfabbb9ed31db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'created_at': datetime.datetime(2026, 7, 8, 0, 29, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 29, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d652479-1a49-4785-9fa6-62d5f48b409f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Trying to clone c8ca2a13-5955-4352-aa77-36d7549ad123 from image 9d652479-1a49-4785-9fa6-62d5f48b409f at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}]). {{(pid=87238) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-62c615d4-6df0-43a5-8708-6a5239519985" returned: 0 in 0.701s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-62c615d4-6df0-43a5-8708-6a5239519985" released by "_copy_volume_from_snapshot" :: held 9.778s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-639af041-a56b-4953-ae12-7fc82577eeec-62c615d4-6df0-43a5-8708-6a5239519985" released by "_create_volume_from_snapshot" :: held 9.822s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.845s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:52:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a329cef0-71e0-4876-b021-e20cc96fe060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62c615d4-6df0-43a5-8708-6a5239519985', 'volume_size': 1, 'snapshot_id': '639af041-a56b-4953-ae12-7fc82577eeec'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:52:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71707324-b527-41a3-bcc5-d24b97ace77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:52:18 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Volume volume-62c615d4-6df0-43a5-8708-6a5239519985 (62c615d4-6df0-43a5-8708-6a5239519985): created successfully Jul 08 02:52:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71707324-b527-41a3-bcc5-d24b97ace77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:52:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Flow 'volume_create_manager' (8b3beb9a-38a8-4ce8-8f2b-db4b53e8c747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:52:18 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-d478646f-2f9b-454f-a61c-191549498943 tempest-VolumesSnapshotTestJSON-606300463 None] Created volume successfully. Jul 08 02:52:18 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_4iwl9qzxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 02:52:18 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Image download 20.69 MB at 20.69 MB/s Jul 08 02:52:18 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42d6e81-bda7-43b4-bb3c-3a89e96ffa03]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_4iwl9qzxdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:18 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_4iwl9qzxdevstack@QuobyteHD Jul 08 02:52:18 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:19 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_4iwl9qzxdevstack@QuobyteHD" returned: 0 in 0.799s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:19 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Temporary image 9d652479-1a49-4785-9fa6-62d5f48b409f is fetched for user e9bed427fe094b58b50f09bdf98eca6e. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 02:52:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-62c615d4-6df0-43a5-8708-6a5239519985-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:52:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-62c615d4-6df0-43a5-8708-6a5239519985-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:52:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-quobyte-62c615d4-6df0-43a5-8708-6a5239519985" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:52:19 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c92607-278d-4bd1-8764-9ff065157e49]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_4iwl9qzxdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-62c615d4-6df0-43a5-8708-6a5239519985" acquired by "delete_volume" :: waited 0.034s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:52:19 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d24e57d-1bd8-4166-804f-caccfb851738]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-62c615d4-6df0-43a5-8708-6a5239519985 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:19 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_4iwl9qzxdevstack@QuobyteHD Jul 08 02:52:19 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:19 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-62c615d4-6df0-43a5-8708-6a5239519985 Jul 08 02:52:19 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:20 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_4iwl9qzxdevstack@QuobyteHD" returned: 0 in 0.756s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-925013704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ca2a13-5955-4352-aa77-36d7549ad123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd1815a8be64216a15d04ac8a042ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:52:17Z,use_quota=True,user_id='e9bed427fe094b58b50f09bdf98eca6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Creating volume c8ca2a13-5955-4352-aa77-36d7549ad123 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:52:20 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:20 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 1073741824 Jul 08 02:52:20 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:20 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-62c615d4-6df0-43a5-8708-6a5239519985" returned: 0 in 0.788s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-62c615d4-6df0-43a5-8708-6a5239519985 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:20 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-62c615d4-6df0-43a5-8708-6a5239519985 Jul 08 02:52:20 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:20 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-62c615d4-6df0-43a5-8708-6a5239519985" returned: 0 in 0.660s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-62c615d4-6df0-43a5-8708-6a5239519985" released by "delete_volume" :: held 1.503s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:20 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 1073741824" returned: 0 in 0.795s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Created reservations ['c1db00ec-012b-4788-beaf-1a70b9b77949', '1e38242b-d97f-4e51-819c-97bcf043730e', '0261aadd-efaa-470a-8c43-ce1eb574a9e9', 'f972a1b2-d0ab-46a6-842d-6619ae35ec1e'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:20 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 Jul 08 02:52:20 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:52:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:20 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:52:20 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-639af041-a56b-4953-ae12-7fc82577eeec-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-639af041-a56b-4953-ae12-7fc82577eeec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-quobyte-44f8cccc-9f8b-4816-b627-765050ca762a" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:52:21 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123" returned: 0 in 0.636s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-44f8cccc-9f8b-4816-b627-765050ca762a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-quobyte-639af041-a56b-4953-ae12-7fc82577eeec" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-639af041-a56b-4953-ae12-7fc82577eeec" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Deleting offline snapshot 639af041-a56b-4953-ae12-7fc82577eeec of volume 44f8cccc-9f8b-4816-b627-765050ca762a {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] snapshot_file for this snap is: volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Attempting download of 9d652479-1a49-4785-9fa6-62d5f48b409f ((None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}])) to volume c8ca2a13-5955-4352-aa77-36d7549ad123. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c00f0fb-fb80-4585-91b8-bc988181f05f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[33866cf4-4878-4c79-b95c-10e3ee6fa7c0]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_r68mzy7h {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:21 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.713s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:52:21 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Deleted volume successfully. Jul 08 02:52:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-87e779be-fae0-4926-a003-04e4bb4253cf tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-62c615d4-6df0-43a5-8708-6a5239519985-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:21 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec Jul 08 02:52:21 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:21 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_r68mzy7h Jul 08 02:52:21 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:22 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec" returned: 0 in 0.760s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44f8cccc-9f8b-4816-b627-765050ca762a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:52:22 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1389ea8c-327a-4ddf-9527-67c8ede7e216]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:22 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_r68mzy7h" returned: 0 in 0.766s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_r68mzy7h {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:22 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a Jul 08 02:52:22 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:22 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_r68mzy7h Jul 08 02:52:22 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:23 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_r68mzy7h" returned: 1 in 0.710s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d652479-1a49-4785-9fa6-62d5f48b409f_r68mzy7h' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:52:23 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a89bbcb-7ebc-414d-ac01-095b1d2d02b9]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_4iwl9qzxdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:23 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a" returned: 0 in 0.767s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:23 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec Jul 08 02:52:23 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:23 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_4iwl9qzxdevstack@QuobyteHD Jul 08 02:52:23 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:23 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_4iwl9qzxdevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:23 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] 9d652479-1a49-4785-9fa6-62d5f48b409f was qcow2, converting to raw {{(pid=87238) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 02:52:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_4iwl9qzxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:23 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_4iwl9qzxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 Jul 08 02:52:23 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:23 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec" returned: 0 in 0.726s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:23 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec Jul 08 02:52:23 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:24 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a.639af041-a56b-4953-ae12-7fc82577eeec" returned: 0 in 0.643s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-639af041-a56b-4953-ae12-7fc82577eeec" released by "_delete_snapshot" :: held 3.018s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-44f8cccc-9f8b-4816-b627-765050ca762a" released by "delete_snapshot" :: held 3.051s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:24 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Created reservations ['fa09b0c6-d0b8-4036-9de7-c60f95302219', 'b3b35f66-d8c2-447c-a710-f23ffff0c473', '06b44b31-21b7-4e3e-973c-5a48d49adc0d', 'ecb02daa-7c40-4362-90c3-2e63f436f841'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:52:24 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Delete snapshot completed successfully. Jul 08 02:52:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0da29043-4be8-4985-b76c-0827a755027e tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-639af041-a56b-4953-ae12-7fc82577eeec-delete_snapshot" released by "delete_snapshot" :: held 3.221s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:25 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_4iwl9qzxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123" returned: 0 in 1.806s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:25 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d652479-1a49-4785-9fa6-62d5f48b409f_4iwl9qzxdevstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:52:25 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Converted 112.00 MB image at 61.97 MB/s Jul 08 02:52:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:25 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 1G Jul 08 02:52:25 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-44f8cccc-9f8b-4816-b627-765050ca762a-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:52:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-44f8cccc-9f8b-4816-b627-765050ca762a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:52:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-quobyte-44f8cccc-9f8b-4816-b627-765050ca762a" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:52:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-44f8cccc-9f8b-4816-b627-765050ca762a" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:52:25 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[3800b9ac-b983-4ef2-805b-0ad4c349a5c3]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:26 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a Jul 08 02:52:26 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:26 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 1G" returned: 0 in 0.700s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:26 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2908ec8-686e-43a3-91ab-9447ab676b35]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:26 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 Jul 08 02:52:26 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:26 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a" returned: 0 in 0.759s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:26 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a Jul 08 02:52:26 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:27 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123" returned: 0 in 0.741s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:27 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 Jul 08 02:52:27 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:27 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44f8cccc-9f8b-4816-b627-765050ca762a" returned: 0 in 0.645s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-44f8cccc-9f8b-4816-b627-765050ca762a" released by "delete_volume" :: held 1.463s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Created reservations ['00a4e774-2ad6-469b-9919-8979054e2a4b', '1c6148c7-228c-4a47-8e1f-2911834d0526', '58754e2e-e495-4ec3-92a3-06ed43354138', '1da78d56-2947-4417-aa4b-53e6cdfe8f38'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:27 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:52:27 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:27 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123" returned: 1 in 0.732s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Downloaded image 9d652479-1a49-4785-9fa6-62d5f48b409f ((None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}])) to volume c8ca2a13-5955-4352-aa77-36d7549ad123 successfully. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Temporary image 9d652479-1a49-4785-9fa6-62d5f48b409f for user e9bed427fe094b58b50f09bdf98eca6e is deleted. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Marking volume c8ca2a13-5955-4352-aa77-36d7549ad123 as bootable. {{(pid=87238) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Copying metadata from image 9d652479-1a49-4785-9fa6-62d5f48b409f to c8ca2a13-5955-4352-aa77-36d7549ad123. {{(pid=87238) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 02:52:27 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Creating volume glance metadata for volume c8ca2a13-5955-4352-aa77-36d7549ad123 backed by image 9d652479-1a49-4785-9fa6-62d5f48b409f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87238) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 02:52:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7291cf0-d86d-41cd-8557-4e96c7682f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ca2a13-5955-4352-aa77-36d7549ad123', 'volume_size': 1, 'image_id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d652479-1a49-4785-9fa6-62d5f48b409f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a21b7084cd94a8dbdfabbb9ed31db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d652479-1a49-4785-9fa6-62d5f48b409f', 'created_at': datetime.datetime(2026, 7, 8, 0, 29, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 29, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d652479-1a49-4785-9fa6-62d5f48b409f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:52:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1e0156-c64e-4937-9428-83376c2545bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:52:28 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Volume volume-c8ca2a13-5955-4352-aa77-36d7549ad123 (c8ca2a13-5955-4352-aa77-36d7549ad123): created successfully Jul 08 02:52:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1e0156-c64e-4937-9428-83376c2545bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:52:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Flow 'volume_create_manager' (fe858cf5-6de6-4a9a-ae15-ea80afa1557a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:52:28 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3c633cfd-b8a5-4340-a17a-eccd327af19a tempest-TestShelveInstance-1152916799 None] Created volume successfully. Jul 08 02:52:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-30c10936-7835-43c0-a866-002ea6e3367e-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:52:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-30c10936-7835-43c0-a866-002ea6e3367e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:52:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "cinder-quobyte-30c10936-7835-43c0-a866-002ea6e3367e" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:52:28 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-30c10936-7835-43c0-a866-002ea6e3367e" acquired by "delete_volume" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:52:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.754s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:28 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:52:28 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Deleted volume successfully. Jul 08 02:52:28 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a83b927-6abf-40a1-a766-88f20122da65]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5d2e7d99-3e26-4a21-917a-930179069d11 tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-44f8cccc-9f8b-4816-b627-765050ca762a-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:28 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e Jul 08 02:52:28 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:28 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e" returned: 0 in 0.754s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:29 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e Jul 08 02:52:29 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:29 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-30c10936-7835-43c0-a866-002ea6e3367e" returned: 0 in 0.708s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-quobyte-30c10936-7835-43c0-a866-002ea6e3367e" released by "delete_volume" :: held 1.523s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:29 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Created reservations ['5c68119f-73a0-4abd-8a6e-32540e60bf50', '8db18cf3-a7b9-4b68-9f13-e1dc1fb133a5', 'ead9788c-b98b-4908-9a41-a67cab47b95c', 'd90df417-8627-4243-8677-dba134df0007'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:52:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:52:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:52:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:52:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:52:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:52:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:29 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:52:29 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:30 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.775s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:30 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:52:30 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Deleted volume successfully. Jul 08 02:52:30 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a9304672-b954-4bd9-a9fd-c686c2ea426d tempest-VolumesSnapshotTestJSON-606300463 None] Lock "cinder-30c10936-7835-43c0-a866-002ea6e3367e-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:52:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-2ef0c2a6-a0d7-4d32-b837-4ccb7c86cf62 req-96bfbb84-9e1a-4b84-8e2c-17278d56b338 tempest-TestShelveInstance-1152916799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:52:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-2ef0c2a6-a0d7-4d32-b837-4ccb7c86cf62 req-96bfbb84-9e1a-4b84-8e2c-17278d56b338 tempest-TestShelveInstance-1152916799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:52:36 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f60c1a-3aa2-4e52-a72a-7808030a34ab]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:52:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-2ef0c2a6-a0d7-4d32-b837-4ccb7c86cf62 req-96bfbb84-9e1a-4b84-8e2c-17278d56b338 tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:37 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 Jul 08 02:52:37 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:37 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-2ef0c2a6-a0d7-4d32-b837-4ccb7c86cf62 req-96bfbb84-9e1a-4b84-8e2c-17278d56b338 tempest-TestShelveInstance-1152916799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123" returned: 0 in 0.922s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-2ef0c2a6-a0d7-4d32-b837-4ccb7c86cf62 req-96bfbb84-9e1a-4b84-8e2c-17278d56b338 tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:37 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 Jul 08 02:52:37 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:38 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-2ef0c2a6-a0d7-4d32-b837-4ccb7c86cf62 req-96bfbb84-9e1a-4b84-8e2c-17278d56b338 tempest-TestShelveInstance-1152916799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123" returned: 1 in 0.822s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-2ef0c2a6-a0d7-4d32-b837-4ccb7c86cf62 req-96bfbb84-9e1a-4b84-8e2c-17278d56b338 tempest-TestShelveInstance-1152916799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:52:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-2ef0c2a6-a0d7-4d32-b837-4ccb7c86cf62 req-96bfbb84-9e1a-4b84-8e2c-17278d56b338 tempest-TestShelveInstance-1152916799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.799s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:52:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-2ef0c2a6-a0d7-4d32-b837-4ccb7c86cf62 req-96bfbb84-9e1a-4b84-8e2c-17278d56b338 tempest-TestShelveInstance-1152916799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-c8ca2a13-5955-4352-aa77-36d7549ad123', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46e60eec-6977-4d30-a99a-de2e2db148f3', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:52:38 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-2ef0c2a6-a0d7-4d32-b837-4ccb7c86cf62 req-96bfbb84-9e1a-4b84-8e2c-17278d56b338 tempest-TestShelveInstance-1152916799 None] attachment_update completed successfully. Jul 08 02:52:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:52:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:52:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:52:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:52:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:52:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:52:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:52:47 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:52:47 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:52:48 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Jul 08 02:52:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.983s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:52:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:52:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:52:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:52:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:52:48 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=70,cinder:DELETE=5,cinder:SELECT=59,cinder:INSERT=18 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:52:48 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=58,cinder:INSERT=26,cinder:UPDATE=59,cinder:DELETE=5 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Flow 'volume_create_manager' (5265609a-a7fc-4ebb-8179-7af95cb02e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0acdf6ef-6c60-46c7-a423-e4d02c699bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0acdf6ef-6c60-46c7-a423-e4d02c699bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1974429159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d4cc5d-0630-4908-86b6-0fd1d234ba53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e39071fa3779420d81ee1dd575a61891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:53:03Z,use_quota=True,user_id='9f93419e2efc43efab12e8697f4d2ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194abd0d-1cb4-4197-a592-edea82cef70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194abd0d-1cb4-4197-a592-edea82cef70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3555ef8f-6d52-49d8-b527-f589fea3659d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3555ef8f-6d52-49d8-b527-f589fea3659d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d4cc5d-0630-4908-86b6-0fd1d234ba53', 'volume_name': 'volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9174757-e373-4068-af8a-576d4217dfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9174757-e373-4068-af8a-576d4217dfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf6ac2f-483c-452b-8a75-faa172272221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:53:02 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Volume 75d4cc5d-0630-4908-86b6-0fd1d234ba53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53', 'volume_size': 1} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1974429159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d4cc5d-0630-4908-86b6-0fd1d234ba53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e39071fa3779420d81ee1dd575a61891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:53:03Z,use_quota=True,user_id='9f93419e2efc43efab12e8697f4d2ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Creating volume 75d4cc5d-0630-4908-86b6-0fd1d234ba53 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:53:02 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:53:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:53:02 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 1073741824 Jul 08 02:53:02 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:53:03 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jul 08 02:53:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 1073741824" returned: 0 in 0.888s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:53:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:53:03 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 Jul 08 02:53:03 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:53:04 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Jul 08 02:53:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53" returned: 0 in 0.666s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:53:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:53:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:53:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf6ac2f-483c-452b-8a75-faa172272221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:53:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71690840-40bb-471b-8f60-26f9173b62d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:53:04 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Volume volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 (75d4cc5d-0630-4908-86b6-0fd1d234ba53): created successfully Jul 08 02:53:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71690840-40bb-471b-8f60-26f9173b62d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:53:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Flow 'volume_create_manager' (5265609a-a7fc-4ebb-8179-7af95cb02e52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:53:04 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-755e4b53-465e-43da-b370-3da309eb4fea tempest-TestStampPattern-1115741669 None] Created volume successfully. Jul 08 02:53:14 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:53:14 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:53:17 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-054233a8-eca2-45ec-a962-89585dcea6fa req-8233cefe-c0bf-4d10-b026-4ba8ca2793e0 tempest-TestShelveInstance-1152916799 None] Terminate volume connection completed successfully. Jul 08 02:53:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-054233a8-eca2-45ec-a962-89585dcea6fa req-8233cefe-c0bf-4d10-b026-4ba8ca2793e0 tempest-TestShelveInstance-1152916799 None] Deleting attachment 46e60eec-6977-4d30-a99a-de2e2db148f3. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:53:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-cc62f8f3-fb52-427e-8008-43b4cb1a7498 req-cdc350e9-3d9b-47bc-a38a-8ff6d2fa21ed tempest-TestShelveInstance-1152916799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:53:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-cc62f8f3-fb52-427e-8008-43b4cb1a7498 req-cdc350e9-3d9b-47bc-a38a-8ff6d2fa21ed tempest-TestShelveInstance-1152916799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:53:23 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ed2e63-8677-4f65-a65a-277743abe695]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:53:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-cc62f8f3-fb52-427e-8008-43b4cb1a7498 req-cdc350e9-3d9b-47bc-a38a-8ff6d2fa21ed tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:53:23 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 Jul 08 02:53:23 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:53:23 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Jul 08 02:53:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-cc62f8f3-fb52-427e-8008-43b4cb1a7498 req-cdc350e9-3d9b-47bc-a38a-8ff6d2fa21ed tempest-TestShelveInstance-1152916799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123" returned: 0 in 0.794s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:53:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-cc62f8f3-fb52-427e-8008-43b4cb1a7498 req-cdc350e9-3d9b-47bc-a38a-8ff6d2fa21ed tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:53:24 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 Jul 08 02:53:24 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:53:24 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Jul 08 02:53:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-cc62f8f3-fb52-427e-8008-43b4cb1a7498 req-cdc350e9-3d9b-47bc-a38a-8ff6d2fa21ed tempest-TestShelveInstance-1152916799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123" returned: 1 in 0.751s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:53:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-cc62f8f3-fb52-427e-8008-43b4cb1a7498 req-cdc350e9-3d9b-47bc-a38a-8ff6d2fa21ed tempest-TestShelveInstance-1152916799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:53:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-cc62f8f3-fb52-427e-8008-43b4cb1a7498 req-cdc350e9-3d9b-47bc-a38a-8ff6d2fa21ed tempest-TestShelveInstance-1152916799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.599s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:53:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-cc62f8f3-fb52-427e-8008-43b4cb1a7498 req-cdc350e9-3d9b-47bc-a38a-8ff6d2fa21ed tempest-TestShelveInstance-1152916799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-c8ca2a13-5955-4352-aa77-36d7549ad123', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13c12856-1507-4478-84fa-253de019420d', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:53:24 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-cc62f8f3-fb52-427e-8008-43b4cb1a7498 req-cdc350e9-3d9b-47bc-a38a-8ff6d2fa21ed tempest-TestShelveInstance-1152916799 None] attachment_update completed successfully. Jul 08 02:53:34 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:53:34 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:53:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-446ffb15-5857-4b7f-b3ca-ac4f8205c355 req-991f0f61-7400-41e9-97d8-bd2e2e540192 tempest-TestStampPattern-1115741669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:53:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-446ffb15-5857-4b7f-b3ca-ac4f8205c355 req-991f0f61-7400-41e9-97d8-bd2e2e540192 tempest-TestStampPattern-1115741669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:53:43 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2b2d56-5d51-4939-b3ab-9e01745f7b0d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:53:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-446ffb15-5857-4b7f-b3ca-ac4f8205c355 req-991f0f61-7400-41e9-97d8-bd2e2e540192 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:53:43 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 Jul 08 02:53:43 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:53:44 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Jul 08 02:53:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-446ffb15-5857-4b7f-b3ca-ac4f8205c355 req-991f0f61-7400-41e9-97d8-bd2e2e540192 tempest-TestStampPattern-1115741669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53" returned: 0 in 0.787s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:53:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-446ffb15-5857-4b7f-b3ca-ac4f8205c355 req-991f0f61-7400-41e9-97d8-bd2e2e540192 tempest-TestStampPattern-1115741669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.813s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:53:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-446ffb15-5857-4b7f-b3ca-ac4f8205c355 req-991f0f61-7400-41e9-97d8-bd2e2e540192 tempest-TestStampPattern-1115741669 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f1155c5-0cb3-48a2-b61c-9cba7c27539f', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:53:44 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-446ffb15-5857-4b7f-b3ca-ac4f8205c355 req-991f0f61-7400-41e9-97d8-bd2e2e540192 tempest-TestStampPattern-1115741669 None] attachment_update completed successfully. Jul 08 02:53:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:53:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:53:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:53:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:53:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:53:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:53:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:53:47 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:53:47 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:53:48 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jul 08 02:53:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.721s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:53:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:53:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:53:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:53:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:53:52 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-a3c979f5-58d4-43f5-9b63-6a695814ff11 req-3cbf502e-eb0f-4ed2-b23c-36b854c1dd80 tempest-TestStampPattern-1115741669 None] Terminate volume connection completed successfully. Jul 08 02:53:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-a3c979f5-58d4-43f5-9b63-6a695814ff11 req-3cbf502e-eb0f-4ed2-b23c-36b854c1dd80 tempest-TestStampPattern-1115741669 None] Deleting attachment 6f1155c5-0cb3-48a2-b61c-9cba7c27539f. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:53:54 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:53:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:53:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:53:54 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] Creating offline snapshot 6ac27953-b8fb-4b86-9c85-8133b2183b9d of volume 75d4cc5d-0630-4908-86b6-0fd1d234ba53 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:53:54 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f922880d-c937-4690-8e15-161a75793f10]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:53:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:53:54 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 Jul 08 02:53:54 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:53:55 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Jul 08 02:53:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53" returned: 0 in 0.760s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:53:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:53:55 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d 1G Jul 08 02:53:55 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:53:56 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Jul 08 02:53:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d 1G" returned: 0 in 0.783s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:53:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:53:56 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d Jul 08 02:53:56 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:53:56 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Jul 08 02:53:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d" returned: 0 in 0.715s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:53:56 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d is being set with open permissions: ugo+rw Jul 08 02:53:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:53:57 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d Jul 08 02:53:57 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:53:57 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Jul 08 02:53:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d" returned: 0 in 0.660s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:53:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:53:57 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.info Jul 08 02:53:57 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:53:58 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jul 08 02:53:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.info" returned: 0 in 0.683s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:53:58 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.info is being set with open permissions: ugo+rw Jul 08 02:53:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:53:58 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.info Jul 08 02:53:58 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:53:58 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Jul 08 02:53:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.info" returned: 0 in 0.645s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:53:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.328s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:53:59 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-7d421fce-0f54-4097-87ec-513dbb136a21 tempest-TestStampPattern-1115741669 None] Create snapshot completed successfully Jul 08 02:54:04 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-e7a5d39b-4c0a-42e5-888c-a390a97467c2 tempest-TestShelveInstance-1152916799 None] Terminate volume connection completed successfully. Jul 08 02:54:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-e7a5d39b-4c0a-42e5-888c-a390a97467c2 tempest-TestShelveInstance-1152916799 None] Deleting attachment 13c12856-1507-4478-84fa-253de019420d. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:54:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Acquiring lock "cinder-c8ca2a13-5955-4352-aa77-36d7549ad123-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Lock "cinder-c8ca2a13-5955-4352-aa77-36d7549ad123-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Acquiring lock "cinder-quobyte-c8ca2a13-5955-4352-aa77-36d7549ad123" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Lock "cinder-quobyte-c8ca2a13-5955-4352-aa77-36d7549ad123" acquired by "delete_volume" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:05 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[e923420b-bece-4c7b-8a0e-a4e27d292917]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:54:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:05 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 Jul 08 02:54:05 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:05 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123" returned: 0 in 0.784s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:06 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 Jul 08 02:54:06 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:06 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123" returned: 1 in 0.801s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:54:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:06 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123 Jul 08 02:54:06 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:07 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8ca2a13-5955-4352-aa77-36d7549ad123" returned: 0 in 0.679s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Lock "cinder-quobyte-c8ca2a13-5955-4352-aa77-36d7549ad123" released by "delete_volume" :: held 2.345s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:07 devstack cinder-volume[87238]: DEBUG cinder.quota [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Created reservations ['925ea81f-1a4f-46a9-b123-0abd8a816666', '8a78423a-62ed-4028-9657-56fec5b40d77', '73f8d5c8-a518-4ee1-b036-9cd0a28c52ca', '20b90a50-b702-4d5a-a1c0-08cd216bf308'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:54:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:54:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:54:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:07 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:54:07 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:08 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.761s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:08 devstack cinder-volume[87238]: DEBUG cinder.manager [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:54:08 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Deleted volume successfully. Jul 08 02:54:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [req-79d62401-a6c9-4d31-b7e2-5ed1b04457f7 req-7115e1ba-95df-41cd-809a-47dfec7438b9 tempest-TestShelveInstance-1152916799 None] Lock "cinder-c8ca2a13-5955-4352-aa77-36d7549ad123-delete_volume" released by "delete_volume" :: held 3.331s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Flow 'volume_create_manager' (2b9b8cfb-6eea-46b3-aac6-543de0babd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb48038-62d8-4974-8a4b-8a46775326cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb48038-62d8-4974-8a4b-8a46775326cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1622812281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e2cc18-11a2-4cfb-8624-d8b8ad72bc32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e39071fa3779420d81ee1dd575a61891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ac27953-b8fb-4b86-9c85-8133b2183b9d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:54:10Z,use_quota=True,user_id='9f93419e2efc43efab12e8697f4d2ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afab3dd4-0a59-46ea-8157-293b7468b38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afab3dd4-0a59-46ea-8157-293b7468b38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7216095c-31bb-4db0-b2e8-9f33f1f2813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7216095c-31bb-4db0-b2e8-9f33f1f2813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '03e2cc18-11a2-4cfb-8624-d8b8ad72bc32', 'volume_name': 'volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32', 'volume_size': 1, 'snapshot_id': '6ac27953-b8fb-4b86-9c85-8133b2183b9d'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75abe07-3268-4d56-90c2-895d042b9d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75abe07-3268-4d56-90c2-895d042b9d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1eb2b44-d0a4-4141-b8ca-cfa1cf88ea44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:09 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Volume 03e2cc18-11a2-4cfb-8624-d8b8ad72bc32: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32', 'volume_size': 1, 'snapshot_id': '6ac27953-b8fb-4b86-9c85-8133b2183b9d'} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Acquiring lock "cinder-quobyte-6ac27953-b8fb-4b86-9c85-8133b2183b9d-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32" by "_create_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Lock "cinder-quobyte-6ac27953-b8fb-4b86-9c85-8133b2183b9d-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Creating volume 03e2cc18-11a2-4cfb-8624-d8b8ad72bc32 from snapshot 6ac27953-b8fb-4b86-9c85-8133b2183b9d {{(pid=87238) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Acquiring lock "cinder-quobyte-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32" by "_copy_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Lock "cinder-quobyte-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] snapshot: 6ac27953-b8fb-4b86-9c85-8133b2183b9d, volume: 03e2cc18-11a2-4cfb-8624-d8b8ad72bc32, {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 02:54:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:54:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:54:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:10 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa2dac3-704d-44da-8b52-d4de1a9a980f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:54:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:10 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d Jul 08 02:54:10 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:10 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d" returned: 0 in 0.927s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:54:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 02:54:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Creating direct copy from snapshot {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 02:54:11 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f51d03f-2db9-46fc-9799-163829256848]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:54:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:11 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 Jul 08 02:54:11 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:11 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53" returned: 0 in 0.966s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:11 devstack cinder-volume[87238]: DEBUG cinder.utils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Path /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32 not found in is_blk_device check {{(pid=87238) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 02:54:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:11 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32 Jul 08 02:54:12 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:18 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32" returned: 0 in 6.215s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:18 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42fd295-959e-4927-a0f3-4832ac7d9196]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:54:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:18 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 Jul 08 02:54:18 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:19 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53" returned: 0 in 1.600s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:19 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:54:19 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Converted 1024.00 MB image at 164.72 MB/s Jul 08 02:54:19 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32 is being set with open permissions: ugo+rw Jul 08 02:54:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:19 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32 Jul 08 02:54:19 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:19 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=11,cinder:SELECT=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:54:19 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=23,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:54:20 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32" returned: 0 in 0.987s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Lock "cinder-quobyte-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32" released by "_copy_volume_from_snapshot" :: held 10.840s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Lock "cinder-quobyte-6ac27953-b8fb-4b86-9c85-8133b2183b9d-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32" released by "_create_volume_from_snapshot" :: held 10.879s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.898s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1eb2b44-d0a4-4141-b8ca-cfa1cf88ea44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32', 'volume_size': 1, 'snapshot_id': '6ac27953-b8fb-4b86-9c85-8133b2183b9d'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96332e11-adeb-4fdb-b0b6-c170a81784dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:20 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Volume volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32 (03e2cc18-11a2-4cfb-8624-d8b8ad72bc32): created successfully Jul 08 02:54:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96332e11-adeb-4fdb-b0b6-c170a81784dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Flow 'volume_create_manager' (2b9b8cfb-6eea-46b3-aac6-543de0babd4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:54:20 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-781ee699-2597-433b-9781-5267025c4427 tempest-TestStampPattern-1115741669 None] Created volume successfully. Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Flow 'volume_create_manager' (1ad17ada-2c05-4d7e-9963-aea87a3385c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bcec0c-22c6-4eaf-9669-d8c883609d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bcec0c-22c6-4eaf-9669-d8c883609d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1965919725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567212f3-4d19-44b2-9bc8-7a31e22a69a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa893e9fe1e9449eb7433e870284af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:54:24Z,use_quota=True,user_id='f2a6f6cf80b948aa8e6f0d6a815a05b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99bbf50b-41c4-4f65-96dc-80ea65bd9fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99bbf50b-41c4-4f65-96dc-80ea65bd9fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2679c852-4fdf-4901-a44a-6728cedac0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2679c852-4fdf-4901-a44a-6728cedac0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '567212f3-4d19-44b2-9bc8-7a31e22a69a6', 'volume_name': 'volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57aa6703-fc29-4738-b601-38c8291bd609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57aa6703-fc29-4738-b601-38c8291bd609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be06b4a7-6d40-4dad-9af6-56e3104a7c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:23 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume 567212f3-4d19-44b2-9bc8-7a31e22a69a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6', 'volume_size': 1} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1965919725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567212f3-4d19-44b2-9bc8-7a31e22a69a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa893e9fe1e9449eb7433e870284af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:54:24Z,use_quota=True,user_id='f2a6f6cf80b948aa8e6f0d6a815a05b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Creating volume 567212f3-4d19-44b2-9bc8-7a31e22a69a6 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:54:23 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:54:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:23 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 1073741824 Jul 08 02:54:23 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:24 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 1073741824" returned: 0 in 0.899s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:24 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 Jul 08 02:54:24 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:25 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6" returned: 0 in 0.672s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:54:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be06b4a7-6d40-4dad-9af6-56e3104a7c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (163901f7-2df3-46e5-90a5-df3bbbf5d420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:25 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 (567212f3-4d19-44b2-9bc8-7a31e22a69a6): created successfully Jul 08 02:54:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (163901f7-2df3-46e5-90a5-df3bbbf5d420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Flow 'volume_create_manager' (1ad17ada-2c05-4d7e-9963-aea87a3385c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:54:25 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f3a4d8fa-39f5-41a3-a95f-e12f8fdd2dda tempest-CreateVolumesFromSnapshotTest-178866200 None] Created volume successfully. Jul 08 02:54:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] Creating offline snapshot 66d82f4c-011d-4839-b0a5-ec88b5e56950 of volume 567212f3-4d19-44b2-9bc8-7a31e22a69a6 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:54:26 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f23a722-4248-49c1-8260-aa5543f324c1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:54:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:26 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 Jul 08 02:54:26 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:26 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6" returned: 0 in 0.807s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:26 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950 1G Jul 08 02:54:26 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:27 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950 1G" returned: 0 in 0.868s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:27 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950 Jul 08 02:54:27 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:28 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950" returned: 0 in 0.763s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:28 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950 is being set with open permissions: ugo+rw Jul 08 02:54:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:28 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950 Jul 08 02:54:28 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:29 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950" returned: 0 in 0.716s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:29 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.info Jul 08 02:54:29 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:29 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.info" returned: 0 in 0.759s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:30 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.info is being set with open permissions: ugo+rw Jul 08 02:54:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:30 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.info Jul 08 02:54:30 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:30 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.info" returned: 0 in 0.719s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.737s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:30 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3fec7afa-4d89-4360-b991-8adf5dd43982 tempest-CreateVolumesFromSnapshotTest-178866200 None] Create snapshot completed successfully Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Flow 'volume_create_manager' (2f6a991f-bd41-4da1-bfb1-992b70a40643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f4eba9-bd55-402a-bdb4-cabceebf9610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f4eba9-bd55-402a-bdb4-cabceebf9610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-229839367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b358d0-ec75-4be2-82a8-8efb4bfd3715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa893e9fe1e9449eb7433e870284af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:54:32Z,use_quota=True,user_id='f2a6f6cf80b948aa8e6f0d6a815a05b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3aa43bf-22f9-4be2-b6f3-92c02c0f876b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3aa43bf-22f9-4be2-b6f3-92c02c0f876b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (debe575e-c405-45fd-b382-87c0938fffc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (debe575e-c405-45fd-b382-87c0938fffc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b358d0-ec75-4be2-82a8-8efb4bfd3715', 'volume_name': 'volume-d0b358d0-ec75-4be2-82a8-8efb4bfd3715', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff97aa5-451c-46ac-8802-5c9d33540b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff97aa5-451c-46ac-8802-5c9d33540b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea7712e-67a0-4223-9220-ea4d928afc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:31 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume d0b358d0-ec75-4be2-82a8-8efb4bfd3715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b358d0-ec75-4be2-82a8-8efb4bfd3715', 'volume_size': 1} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-229839367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b358d0-ec75-4be2-82a8-8efb4bfd3715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa893e9fe1e9449eb7433e870284af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:54:32Z,use_quota=True,user_id='f2a6f6cf80b948aa8e6f0d6a815a05b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Creating volume d0b358d0-ec75-4be2-82a8-8efb4bfd3715 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:54:31 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:54:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d0b358d0-ec75-4be2-82a8-8efb4bfd3715 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:31 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d0b358d0-ec75-4be2-82a8-8efb4bfd3715 1073741824 Jul 08 02:54:31 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Flow 'volume_create_manager' (67a7631e-90c8-4b6d-a460-7bd53af6856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74346b84-2cb8-4c30-a82e-89348812c0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74346b84-2cb8-4c30-a82e-89348812c0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2010889762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c47a2f0-a555-4fbd-8a17-871034af20e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa893e9fe1e9449eb7433e870284af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:54:32Z,use_quota=True,user_id='f2a6f6cf80b948aa8e6f0d6a815a05b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d4bd19-52f6-4037-ae0e-40f60e45bbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d4bd19-52f6-4037-ae0e-40f60e45bbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a03032-39fd-476c-b5e4-fb657572324e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a03032-39fd-476c-b5e4-fb657572324e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c47a2f0-a555-4fbd-8a17-871034af20e4', 'volume_name': 'volume-9c47a2f0-a555-4fbd-8a17-871034af20e4', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c0941d-b77e-46ba-9407-fe1c229f9f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c0941d-b77e-46ba-9407-fe1c229f9f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fddb60c-f72a-4ff7-8c46-35051433d279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:32 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume 9c47a2f0-a555-4fbd-8a17-871034af20e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c47a2f0-a555-4fbd-8a17-871034af20e4', 'volume_size': 1} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Flow 'volume_create_manager' (88e00368-a7c7-4d6e-a69d-d01598764dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc329d7c-a88e-4ee3-8ff9-667318b66e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc329d7c-a88e-4ee3-8ff9-667318b66e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-554129328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0ec7d2-9658-442f-8b67-48f112c1f3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa893e9fe1e9449eb7433e870284af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:54:33Z,use_quota=True,user_id='f2a6f6cf80b948aa8e6f0d6a815a05b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093d1a0a-fcd3-4af0-99ca-e52d401aae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093d1a0a-fcd3-4af0-99ca-e52d401aae82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98147a09-545c-4ccc-b3f8-abc0b2561948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98147a09-545c-4ccc-b3f8-abc0b2561948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b0ec7d2-9658-442f-8b67-48f112c1f3f2', 'volume_name': 'volume-7b0ec7d2-9658-442f-8b67-48f112c1f3f2', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4fbc551-9d8c-4739-a182-67741ba8bbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4fbc551-9d8c-4739-a182-67741ba8bbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47980bd4-56ae-440a-b8d3-08b6443772f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:32 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume 7b0ec7d2-9658-442f-8b67-48f112c1f3f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b0ec7d2-9658-442f-8b67-48f112c1f3f2', 'volume_size': 1} Jul 08 02:54:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:33 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d0b358d0-ec75-4be2-82a8-8efb4bfd3715 1073741824" returned: 0 in 1.153s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d0b358d0-ec75-4be2-82a8-8efb4bfd3715 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:54:33 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d0b358d0-ec75-4be2-82a8-8efb4bfd3715 Jul 08 02:54:33 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Flow 'volume_create_manager' (9bd6d878-5a03-4576-a233-14d7a331845b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a81a06c-0bee-4c8a-8f6e-053d99f754fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a81a06c-0bee-4c8a-8f6e-053d99f754fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-941991754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84aa8a3b-22fe-41e0-9b81-607b689df1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa893e9fe1e9449eb7433e870284af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:54:33Z,use_quota=True,user_id='f2a6f6cf80b948aa8e6f0d6a815a05b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bebeed7b-9964-42a1-b9a8-3d3fe9c2d37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bebeed7b-9964-42a1-b9a8-3d3fe9c2d37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c633d1-b1e5-4eb4-a896-1cfcd8f58ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c633d1-b1e5-4eb4-a896-1cfcd8f58ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84aa8a3b-22fe-41e0-9b81-607b689df1ff', 'volume_name': 'volume-84aa8a3b-22fe-41e0-9b81-607b689df1ff', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe7d000-b9d8-4c68-a878-df60d1b44fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe7d000-b9d8-4c68-a878-df60d1b44fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3aa029d-3dc1-4519-9d8f-349ad07f9c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:33 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume 84aa8a3b-22fe-41e0-9b81-607b689df1ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84aa8a3b-22fe-41e0-9b81-607b689df1ff', 'volume_size': 1} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Flow 'volume_create_manager' (833659e6-40bd-4eeb-a6b1-1ac61c6f9168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c099a523-bbde-488f-bf04-479b67b5402f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c099a523-bbde-488f-bf04-479b67b5402f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2008216990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9189db-105f-4d3b-b358-62838d9e1036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa893e9fe1e9449eb7433e870284af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:54:34Z,use_quota=True,user_id='f2a6f6cf80b948aa8e6f0d6a815a05b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a745877d-f4ff-43f6-8ea0-a0ce873e44e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a745877d-f4ff-43f6-8ea0-a0ce873e44e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd905a3-7502-4f36-8142-955d82c44a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd905a3-7502-4f36-8142-955d82c44a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9189db-105f-4d3b-b358-62838d9e1036', 'volume_name': 'volume-5d9189db-105f-4d3b-b358-62838d9e1036', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f17ea5d-4c01-4492-9fac-5d73159a6c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f17ea5d-4c01-4492-9fac-5d73159a6c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08be5129-2fe8-44c7-a98f-104fb3b37897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:33 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume 5d9189db-105f-4d3b-b358-62838d9e1036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9189db-105f-4d3b-b358-62838d9e1036', 'volume_size': 1} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:33 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d0b358d0-ec75-4be2-82a8-8efb4bfd3715" returned: 0 in 0.826s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.638s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2010889762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c47a2f0-a555-4fbd-8a17-871034af20e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa893e9fe1e9449eb7433e870284af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:54:32Z,use_quota=True,user_id='f2a6f6cf80b948aa8e6f0d6a815a05b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Creating volume 9c47a2f0-a555-4fbd-8a17-871034af20e4 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:54:33 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9c47a2f0-a555-4fbd-8a17-871034af20e4 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:33 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9c47a2f0-a555-4fbd-8a17-871034af20e4 1073741824 Jul 08 02:54:33 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea7712e-67a0-4223-9220-ea4d928afc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b358d0-ec75-4be2-82a8-8efb4bfd3715', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a654456-2e46-470b-b964-10798acf5d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:34 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume volume-d0b358d0-ec75-4be2-82a8-8efb4bfd3715 (d0b358d0-ec75-4be2-82a8-8efb4bfd3715): created successfully Jul 08 02:54:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a654456-2e46-470b-b964-10798acf5d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Flow 'volume_create_manager' (2f6a991f-bd41-4da1-bfb1-992b70a40643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:54:34 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-773c90d4-562b-472b-932f-bb65effe07b5 tempest-CreateVolumesFromSnapshotTest-178866200 None] Created volume successfully. Jul 08 02:54:34 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9c47a2f0-a555-4fbd-8a17-871034af20e4 1073741824" returned: 0 in 0.894s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9c47a2f0-a555-4fbd-8a17-871034af20e4 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:34 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9c47a2f0-a555-4fbd-8a17-871034af20e4 Jul 08 02:54:34 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:35 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9c47a2f0-a555-4fbd-8a17-871034af20e4" returned: 0 in 0.681s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.767s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-554129328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0ec7d2-9658-442f-8b67-48f112c1f3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa893e9fe1e9449eb7433e870284af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:54:33Z,use_quota=True,user_id='f2a6f6cf80b948aa8e6f0d6a815a05b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Creating volume 7b0ec7d2-9658-442f-8b67-48f112c1f3f2 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:54:35 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b0ec7d2-9658-442f-8b67-48f112c1f3f2 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:35 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b0ec7d2-9658-442f-8b67-48f112c1f3f2 1073741824 Jul 08 02:54:35 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fddb60c-f72a-4ff7-8c46-35051433d279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c47a2f0-a555-4fbd-8a17-871034af20e4', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0fb6bb-623b-4cb6-a1dc-8489310b773b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:35 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume volume-9c47a2f0-a555-4fbd-8a17-871034af20e4 (9c47a2f0-a555-4fbd-8a17-871034af20e4): created successfully Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0fb6bb-623b-4cb6-a1dc-8489310b773b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:35 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Flow 'volume_create_manager' (67a7631e-90c8-4b6d-a460-7bd53af6856b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:54:35 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-918c8b3c-b862-4615-9730-0b2cf46b2234 tempest-CreateVolumesFromSnapshotTest-178866200 None] Created volume successfully. Jul 08 02:54:36 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b0ec7d2-9658-442f-8b67-48f112c1f3f2 1073741824" returned: 0 in 0.855s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b0ec7d2-9658-442f-8b67-48f112c1f3f2 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:36 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b0ec7d2-9658-442f-8b67-48f112c1f3f2 Jul 08 02:54:36 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:37 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b0ec7d2-9658-442f-8b67-48f112c1f3f2" returned: 0 in 0.655s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.839s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-941991754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84aa8a3b-22fe-41e0-9b81-607b689df1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa893e9fe1e9449eb7433e870284af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:54:33Z,use_quota=True,user_id='f2a6f6cf80b948aa8e6f0d6a815a05b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Creating volume 84aa8a3b-22fe-41e0-9b81-607b689df1ff {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:54:37 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-84aa8a3b-22fe-41e0-9b81-607b689df1ff 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:37 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-84aa8a3b-22fe-41e0-9b81-607b689df1ff 1073741824 Jul 08 02:54:37 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47980bd4-56ae-440a-b8d3-08b6443772f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b0ec7d2-9658-442f-8b67-48f112c1f3f2', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d95940-50e2-4ea8-8083-eea77e8aa84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:37 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume volume-7b0ec7d2-9658-442f-8b67-48f112c1f3f2 (7b0ec7d2-9658-442f-8b67-48f112c1f3f2): created successfully Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d95940-50e2-4ea8-8083-eea77e8aa84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Flow 'volume_create_manager' (88e00368-a7c7-4d6e-a69d-d01598764dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:54:37 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f3ca8cb8-4ab6-4dcd-b580-a2c806c79891 tempest-CreateVolumesFromSnapshotTest-178866200 None] Created volume successfully. Jul 08 02:54:37 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-84aa8a3b-22fe-41e0-9b81-607b689df1ff 1073741824" returned: 0 in 0.844s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-84aa8a3b-22fe-41e0-9b81-607b689df1ff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:38 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-84aa8a3b-22fe-41e0-9b81-607b689df1ff Jul 08 02:54:38 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:38 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-84aa8a3b-22fe-41e0-9b81-607b689df1ff" returned: 0 in 0.660s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.959s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2008216990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9189db-105f-4d3b-b358-62838d9e1036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa893e9fe1e9449eb7433e870284af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:54:34Z,use_quota=True,user_id='f2a6f6cf80b948aa8e6f0d6a815a05b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Creating volume 5d9189db-105f-4d3b-b358-62838d9e1036 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:54:38 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5d9189db-105f-4d3b-b358-62838d9e1036 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3aa029d-3dc1-4519-9d8f-349ad07f9c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84aa8a3b-22fe-41e0-9b81-607b689df1ff', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:38 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5d9189db-105f-4d3b-b358-62838d9e1036 1073741824 Jul 08 02:54:38 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1572b00d-6712-4ff9-9c0e-e55586144dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:38 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume volume-84aa8a3b-22fe-41e0-9b81-607b689df1ff (84aa8a3b-22fe-41e0-9b81-607b689df1ff): created successfully Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1572b00d-6712-4ff9-9c0e-e55586144dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:38 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Flow 'volume_create_manager' (9bd6d878-5a03-4576-a233-14d7a331845b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:54:38 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f410aeb5-7b3f-4610-b397-06b35a9b121a tempest-CreateVolumesFromSnapshotTest-178866200 None] Created volume successfully. Jul 08 02:54:39 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5d9189db-105f-4d3b-b358-62838d9e1036 1073741824" returned: 0 in 0.838s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5d9189db-105f-4d3b-b358-62838d9e1036 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:39 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5d9189db-105f-4d3b-b358-62838d9e1036 Jul 08 02:54:39 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:40 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5d9189db-105f-4d3b-b358-62838d9e1036" returned: 0 in 0.654s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:40 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:54:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08be5129-2fe8-44c7-a98f-104fb3b37897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9189db-105f-4d3b-b358-62838d9e1036', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb8ce45-0350-4861-a516-b2d3ed819e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:54:40 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Volume volume-5d9189db-105f-4d3b-b358-62838d9e1036 (5d9189db-105f-4d3b-b358-62838d9e1036): created successfully Jul 08 02:54:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb8ce45-0350-4861-a516-b2d3ed819e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:54:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Flow 'volume_create_manager' (833659e6-40bd-4eeb-a6b1-1ac61c6f9168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:54:40 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-debb2b30-5e98-421f-834b-760dc18e66bb tempest-CreateVolumesFromSnapshotTest-178866200 None] Created volume successfully. Jul 08 02:54:41 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "cinder-5d9189db-105f-4d3b-b358-62838d9e1036-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:41 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-5d9189db-105f-4d3b-b358-62838d9e1036-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:41 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "cinder-quobyte-5d9189db-105f-4d3b-b358-62838d9e1036" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:41 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-quobyte-5d9189db-105f-4d3b-b358-62838d9e1036" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:41 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1c7fe0-1e57-4ed9-8dcd-5e3fcd045d92]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:54:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5d9189db-105f-4d3b-b358-62838d9e1036 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:41 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5d9189db-105f-4d3b-b358-62838d9e1036 Jul 08 02:54:41 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:42 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5d9189db-105f-4d3b-b358-62838d9e1036" returned: 0 in 0.745s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5d9189db-105f-4d3b-b358-62838d9e1036 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:42 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5d9189db-105f-4d3b-b358-62838d9e1036 Jul 08 02:54:42 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:42 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-5d9189db-105f-4d3b-b358-62838d9e1036" returned: 0 in 0.635s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-quobyte-5d9189db-105f-4d3b-b358-62838d9e1036" released by "delete_volume" :: held 1.421s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:42 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Created reservations ['b876d656-d75a-4be1-b97b-5b7f1eb301e5', '49683f19-5884-4596-9997-31840328cb7c', 'ff0afe30-083d-4595-8ce5-9b456eccbfb5', '4c9de303-0775-4ba7-a8de-fe5da3a5b7f7'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:54:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:42 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:54:42 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:54:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:42 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:54:42 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "cinder-84aa8a3b-22fe-41e0-9b81-607b689df1ff-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-84aa8a3b-22fe-41e0-9b81-607b689df1ff-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:43 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.652s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:43 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:54:43 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Deleted volume successfully. Jul 08 02:54:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "cinder-quobyte-84aa8a3b-22fe-41e0-9b81-607b689df1ff" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d788da6c-95b4-4bab-bb47-375a06e4a091 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-5d9189db-105f-4d3b-b358-62838d9e1036-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-quobyte-84aa8a3b-22fe-41e0-9b81-607b689df1ff" acquired by "delete_volume" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:43 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe458e5-2ea1-431d-a16d-e95b1e0c7ed4]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:54:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-84aa8a3b-22fe-41e0-9b81-607b689df1ff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:43 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-84aa8a3b-22fe-41e0-9b81-607b689df1ff Jul 08 02:54:43 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:44 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-84aa8a3b-22fe-41e0-9b81-607b689df1ff" returned: 0 in 0.761s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-84aa8a3b-22fe-41e0-9b81-607b689df1ff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:44 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-84aa8a3b-22fe-41e0-9b81-607b689df1ff Jul 08 02:54:44 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:45 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-84aa8a3b-22fe-41e0-9b81-607b689df1ff" returned: 0 in 0.656s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-quobyte-84aa8a3b-22fe-41e0-9b81-607b689df1ff" released by "delete_volume" :: held 1.455s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Created reservations ['38c74b84-dda8-4514-a42e-652e8d2553ae', '9ba44b0d-13b8-47ff-8a1a-80385a180961', 'd5ec5a73-e61a-4250-9cdc-7fe5e3155e05', 'cd1602c5-d86a-4be5-b56c-3ce532aba186'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:45 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:54:45 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "cinder-7b0ec7d2-9658-442f-8b67-48f112c1f3f2-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-7b0ec7d2-9658-442f-8b67-48f112c1f3f2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "cinder-quobyte-7b0ec7d2-9658-442f-8b67-48f112c1f3f2" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-quobyte-7b0ec7d2-9658-442f-8b67-48f112c1f3f2" acquired by "delete_volume" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:45 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.669s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:54:45 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Deleted volume successfully. Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5dd29d-c78b-4007-bf02-f737685fe04d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b0ec7d2-9658-442f-8b67-48f112c1f3f2 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8225e5ea-1e87-4ad6-984b-f103c43d0291 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-84aa8a3b-22fe-41e0-9b81-607b689df1ff-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:45 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b0ec7d2-9658-442f-8b67-48f112c1f3f2 Jul 08 02:54:45 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:46 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b0ec7d2-9658-442f-8b67-48f112c1f3f2" returned: 0 in 0.767s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b0ec7d2-9658-442f-8b67-48f112c1f3f2 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:46 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b0ec7d2-9658-442f-8b67-48f112c1f3f2 Jul 08 02:54:46 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:47 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7b0ec7d2-9658-442f-8b67-48f112c1f3f2" returned: 0 in 0.640s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-quobyte-7b0ec7d2-9658-442f-8b67-48f112c1f3f2" released by "delete_volume" :: held 1.449s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:47 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:54:47 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Created reservations ['479e13c6-5c47-45d0-b79c-cae0135213f8', '7bf7c70b-0b98-40ea-92de-47bd4c16b9ca', '96965ec2-4415-40ef-8236-1dfe5f8494c2', 'ce260dcb-7e22-499f-b3af-45bd3302c176'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:47 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:54:47 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:47 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.660s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "cinder-9c47a2f0-a555-4fbd-8a17-871034af20e4-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:54:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-9c47a2f0-a555-4fbd-8a17-871034af20e4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "cinder-quobyte-9c47a2f0-a555-4fbd-8a17-871034af20e4" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-quobyte-9c47a2f0-a555-4fbd-8a17-871034af20e4" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:48 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f39ab5c-dfd3-4b4c-bc9e-e28618f26e08]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:54:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9c47a2f0-a555-4fbd-8a17-871034af20e4 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:48 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.692s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:54:48 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Deleted volume successfully. Jul 08 02:54:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dbdeee6c-6b18-41a0-bd33-53691afb150d tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-7b0ec7d2-9658-442f-8b67-48f112c1f3f2-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:48 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9c47a2f0-a555-4fbd-8a17-871034af20e4 Jul 08 02:54:48 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:48 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9c47a2f0-a555-4fbd-8a17-871034af20e4" returned: 0 in 0.761s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9c47a2f0-a555-4fbd-8a17-871034af20e4 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:48 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9c47a2f0-a555-4fbd-8a17-871034af20e4 Jul 08 02:54:48 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:49 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-9c47a2f0-a555-4fbd-8a17-871034af20e4" returned: 0 in 0.673s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-quobyte-9c47a2f0-a555-4fbd-8a17-871034af20e4" released by "delete_volume" :: held 1.476s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:49 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Created reservations ['814aeaf0-4ca2-40f1-8e12-b4f8acec12d4', '1efb6043-97d8-4488-8253-a571fdeeee77', 'ea903529-64e2-449c-80a2-5779935d5a91', '5e3e4b32-37de-4d6e-b226-46e3926d0a7f'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:54:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:54:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:54:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:49 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:54:49 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "cinder-d0b358d0-ec75-4be2-82a8-8efb4bfd3715-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-d0b358d0-ec75-4be2-82a8-8efb4bfd3715-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "cinder-quobyte-d0b358d0-ec75-4be2-82a8-8efb4bfd3715" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-quobyte-d0b358d0-ec75-4be2-82a8-8efb4bfd3715" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:50 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e312866-d2da-4cf8-9de1-0484f6f28e66]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:54:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d0b358d0-ec75-4be2-82a8-8efb4bfd3715 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:50 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.686s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:50 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:54:50 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Deleted volume successfully. Jul 08 02:54:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c3b6fa57-afb8-4e5b-a1ea-2258ef2bb70b tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-9c47a2f0-a555-4fbd-8a17-871034af20e4-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:50 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d0b358d0-ec75-4be2-82a8-8efb4bfd3715 Jul 08 02:54:50 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:51 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d0b358d0-ec75-4be2-82a8-8efb4bfd3715" returned: 0 in 0.764s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d0b358d0-ec75-4be2-82a8-8efb4bfd3715 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:51 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d0b358d0-ec75-4be2-82a8-8efb4bfd3715 Jul 08 02:54:51 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:51 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d0b358d0-ec75-4be2-82a8-8efb4bfd3715" returned: 0 in 0.635s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-quobyte-d0b358d0-ec75-4be2-82a8-8efb4bfd3715" released by "delete_volume" :: held 1.445s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:51 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Created reservations ['b5ea2e99-8bda-410a-a32b-4664933244be', 'd876ee87-d294-495a-a736-51e892019c44', 'cd889dde-4531-402b-a919-637e9f90c528', '73cbecc6-989a-4380-a8bf-4d4785a8ac2c'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:54:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:54:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:54:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:51 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:54:51 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "cinder-66d82f4c-011d-4839-b0a5-ec88b5e56950-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:52 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.641s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:52 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:54:52 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Deleted volume successfully. Jul 08 02:54:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-66d82f4c-011d-4839-b0a5-ec88b5e56950-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "cinder-quobyte-567212f3-4d19-44b2-9bc8-7a31e22a69a6" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-quobyte-567212f3-4d19-44b2-9bc8-7a31e22a69a6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "cinder-quobyte-66d82f4c-011d-4839-b0a5-ec88b5e56950" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0bf22064-165f-49c5-9874-377f38c9a647 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-d0b358d0-ec75-4be2-82a8-8efb4bfd3715-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-quobyte-66d82f4c-011d-4839-b0a5-ec88b5e56950" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Deleting offline snapshot 66d82f4c-011d-4839-b0a5-ec88b5e56950 of volume 567212f3-4d19-44b2-9bc8-7a31e22a69a6 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:54:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] snapshot_file for this snap is: volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:54:52 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf40817-c61e-42d6-80a7-3fcf74be43f1]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:54:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:52 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950 Jul 08 02:54:52 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:53 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950" returned: 0 in 0.760s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:54:53 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b5029c-ef7c-4332-b357-3194acb85f10]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:54:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:53 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 Jul 08 02:54:53 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:54 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6" returned: 0 in 0.762s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:54 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950 Jul 08 02:54:54 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:54 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950" returned: 0 in 0.763s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:54 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950 Jul 08 02:54:54 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:55 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6.66d82f4c-011d-4839-b0a5-ec88b5e56950" returned: 0 in 0.634s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-quobyte-66d82f4c-011d-4839-b0a5-ec88b5e56950" released by "_delete_snapshot" :: held 3.045s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-quobyte-567212f3-4d19-44b2-9bc8-7a31e22a69a6" released by "delete_snapshot" :: held 3.082s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-3deaecff-1c24-4aff-8402-281af4eb517d req-5d641116-f99e-4308-af65-017e0b7e3981 tempest-TestStampPattern-1115741669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-3deaecff-1c24-4aff-8402-281af4eb517d req-5d641116-f99e-4308-af65-017e0b7e3981 tempest-TestStampPattern-1115741669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:55 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf61d86-d587-4d42-a6f8-ad63492d45f9]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:54:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-3deaecff-1c24-4aff-8402-281af4eb517d req-5d641116-f99e-4308-af65-017e0b7e3981 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:55 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Created reservations ['f0e7380b-6a4f-41cf-ae99-38d8163f6920', '3179a696-6d9a-4543-a85a-1ad78707421a', '1d997de1-01b4-4158-985f-86566b2afa3c', '57f5a49f-9567-4a30-882c-ab214c3e3974'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:54:55 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Delete snapshot completed successfully. Jul 08 02:54:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-099a097a-b846-48aa-ab36-2f0fe509fe57 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-66d82f4c-011d-4839-b0a5-ec88b5e56950-delete_snapshot" released by "delete_snapshot" :: held 3.241s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:55 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32 Jul 08 02:54:55 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:56 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [req-3deaecff-1c24-4aff-8402-281af4eb517d req-5d641116-f99e-4308-af65-017e0b7e3981 tempest-TestStampPattern-1115741669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32" returned: 0 in 0.754s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [req-3deaecff-1c24-4aff-8402-281af4eb517d req-5d641116-f99e-4308-af65-017e0b7e3981 tempest-TestStampPattern-1115741669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.773s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-3deaecff-1c24-4aff-8402-281af4eb517d req-5d641116-f99e-4308-af65-017e0b7e3981 tempest-TestStampPattern-1115741669 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0', 'name': 'volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21b66d98-40cf-4774-b286-5909ec4a0b5f', 'enforce_multipath': True} {{(pid=87238) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:54:56 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-3deaecff-1c24-4aff-8402-281af4eb517d req-5d641116-f99e-4308-af65-017e0b7e3981 tempest-TestStampPattern-1115741669 None] attachment_update completed successfully. Jul 08 02:54:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "cinder-567212f3-4d19-44b2-9bc8-7a31e22a69a6-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-567212f3-4d19-44b2-9bc8-7a31e22a69a6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "cinder-quobyte-567212f3-4d19-44b2-9bc8-7a31e22a69a6" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:54:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-quobyte-567212f3-4d19-44b2-9bc8-7a31e22a69a6" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:54:56 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[b410bb2a-f414-4aec-ac34-5ac98c08dd67]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:54:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:56 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 Jul 08 02:54:56 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:57 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6" returned: 0 in 0.783s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:57 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6 Jul 08 02:54:57 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:58 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-567212f3-4d19-44b2-9bc8-7a31e22a69a6" returned: 0 in 0.647s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-quobyte-567212f3-4d19-44b2-9bc8-7a31e22a69a6" released by "delete_volume" :: held 1.498s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:54:58 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Created reservations ['61d87e2b-9dfb-48b7-8f2f-30e185d1ca0a', '33069c81-984b-4bdb-81bc-b76bac7c637b', '0f18433a-184e-4272-9723-c95794f9ae7e', 'f9483c42-440f-4b6c-a98d-5461fe1a699e'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:54:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:54:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:54:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:54:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:54:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:54:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:54:58 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:54:58 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:54:59 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Jul 08 02:54:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.680s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:54:59 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:54:59 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Deleted volume successfully. Jul 08 02:54:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f4060ec1-de1f-417c-8090-0ff93ce50c98 tempest-CreateVolumesFromSnapshotTest-178866200 None] Lock "cinder-567212f3-4d19-44b2-9bc8-7a31e22a69a6-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:01 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Flow 'volume_create_manager' (4223eb4c-059c-4ae9-8447-eb169f743cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324b5b0c-d7f6-49d2-9f33-9fd17662e2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324b5b0c-d7f6-49d2-9f33-9fd17662e2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-887905318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e340dfc-2e8a-406c-b287-d5210335b190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27da98c8f28b4cc6b783804a7690a32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:55:02Z,use_quota=True,user_id='e582ac11e3d54862a9bbf2224b13b246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f6b873-e424-4a42-bd4e-8c7d09ed18c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f6b873-e424-4a42-bd4e-8c7d09ed18c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8621d50-858c-4b12-be07-46700904fc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8621d50-858c-4b12-be07-46700904fc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e340dfc-2e8a-406c-b287-d5210335b190', 'volume_name': 'volume-8e340dfc-2e8a-406c-b287-d5210335b190', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4911472b-b8c7-45d7-b773-c653f3e715cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4911472b-b8c7-45d7-b773-c653f3e715cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0c934c-e8fb-4d4e-ac19-fce48822bcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:02 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume 8e340dfc-2e8a-406c-b287-d5210335b190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e340dfc-2e8a-406c-b287-d5210335b190', 'volume_size': 1} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-887905318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e340dfc-2e8a-406c-b287-d5210335b190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27da98c8f28b4cc6b783804a7690a32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:55:02Z,use_quota=True,user_id='e582ac11e3d54862a9bbf2224b13b246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Creating volume 8e340dfc-2e8a-406c-b287-d5210335b190 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:55:02 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e340dfc-2e8a-406c-b287-d5210335b190 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:02 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e340dfc-2e8a-406c-b287-d5210335b190 1073741824 Jul 08 02:55:02 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:02 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e340dfc-2e8a-406c-b287-d5210335b190 1073741824" returned: 0 in 0.852s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e340dfc-2e8a-406c-b287-d5210335b190 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:03 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e340dfc-2e8a-406c-b287-d5210335b190 Jul 08 02:55:03 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:03 devstack cinder-volume[87238]: INFO cinder.volume.manager [req-cc7611f0-3273-4786-919e-84e436cffc55 req-d68a84d8-ce7e-4cd3-90d0-64399c51e443 tempest-TestStampPattern-1115741669 None] Terminate volume connection completed successfully. Jul 08 02:55:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [req-cc7611f0-3273-4786-919e-84e436cffc55 req-d68a84d8-ce7e-4cd3-90d0-64399c51e443 tempest-TestStampPattern-1115741669 None] Deleting attachment 21b66d98-40cf-4774-b286-5909ec4a0b5f. {{(pid=87238) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:55:03 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e340dfc-2e8a-406c-b287-d5210335b190" returned: 0 in 0.704s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:55:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0c934c-e8fb-4d4e-ac19-fce48822bcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e340dfc-2e8a-406c-b287-d5210335b190', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a969c9c-2ba2-4bcb-af7b-2e6b9bb64ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:03 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume volume-8e340dfc-2e8a-406c-b287-d5210335b190 (8e340dfc-2e8a-406c-b287-d5210335b190): created successfully Jul 08 02:55:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a969c9c-2ba2-4bcb-af7b-2e6b9bb64ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Flow 'volume_create_manager' (4223eb4c-059c-4ae9-8447-eb169f743cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:55:03 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-504a6fe5-790e-449a-968d-4f4ac8ee092d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Created volume successfully. Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Flow 'volume_create_manager' (58cb3ead-db16-42d0-9ef2-523b75c3c15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b53d371-6167-435e-979f-cbff9e0b5bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b53d371-6167-435e-979f-cbff9e0b5bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-245420588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99524c58-0d76-49a6-ad54-09bd8344776d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27da98c8f28b4cc6b783804a7690a32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:55:04Z,use_quota=True,user_id='e582ac11e3d54862a9bbf2224b13b246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19229a8e-17d1-4a9e-86bd-e39858851bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19229a8e-17d1-4a9e-86bd-e39858851bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3daa4918-eaa0-4151-af6d-c560bcc5562a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3daa4918-eaa0-4151-af6d-c560bcc5562a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99524c58-0d76-49a6-ad54-09bd8344776d', 'volume_name': 'volume-99524c58-0d76-49a6-ad54-09bd8344776d', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9a76e7-2676-4409-9b40-97897c40f04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9a76e7-2676-4409-9b40-97897c40f04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a322521d-a8be-45de-8952-93ad3d6145a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:04 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume 99524c58-0d76-49a6-ad54-09bd8344776d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99524c58-0d76-49a6-ad54-09bd8344776d', 'volume_size': 1} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-245420588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99524c58-0d76-49a6-ad54-09bd8344776d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27da98c8f28b4cc6b783804a7690a32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:55:04Z,use_quota=True,user_id='e582ac11e3d54862a9bbf2224b13b246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Creating volume 99524c58-0d76-49a6-ad54-09bd8344776d {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:55:04 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-99524c58-0d76-49a6-ad54-09bd8344776d 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:04 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-99524c58-0d76-49a6-ad54-09bd8344776d 1073741824 Jul 08 02:55:04 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Flow 'volume_create_manager' (2a423739-5c91-48ce-82ae-289b03fff1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ece8c7-c8aa-4eea-9ed4-9fe68dae71d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ece8c7-c8aa-4eea-9ed4-9fe68dae71d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1860873211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2178ff47-c4ec-4fe9-b673-61c5d0db3142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27da98c8f28b4cc6b783804a7690a32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:55:05Z,use_quota=True,user_id='e582ac11e3d54862a9bbf2224b13b246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f0bc4b-8ee1-4b2b-bc74-f0c33819f16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f0bc4b-8ee1-4b2b-bc74-f0c33819f16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e756fad9-6003-41d6-af5d-cbbfc427237b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e756fad9-6003-41d6-af5d-cbbfc427237b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2178ff47-c4ec-4fe9-b673-61c5d0db3142', 'volume_name': 'volume-2178ff47-c4ec-4fe9-b673-61c5d0db3142', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a73765-ef44-4bb7-8658-9a213e59714d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a73765-ef44-4bb7-8658-9a213e59714d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9824e522-dd12-4366-a85e-95b5490e18dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:04 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume 2178ff47-c4ec-4fe9-b673-61c5d0db3142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2178ff47-c4ec-4fe9-b673-61c5d0db3142', 'volume_size': 1} Jul 08 02:55:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Flow 'volume_create_manager' (bf1d3212-717f-4c63-985f-a1918c9e8828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf5c31f-d5d4-476d-a5b6-92e71321436b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf5c31f-d5d4-476d-a5b6-92e71321436b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-599683889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673b1561-e24a-4c60-9ea1-a9ea93d55bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27da98c8f28b4cc6b783804a7690a32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:55:05Z,use_quota=True,user_id='e582ac11e3d54862a9bbf2224b13b246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f907d3-fffd-4aef-a98a-9fef29d95346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f907d3-fffd-4aef-a98a-9fef29d95346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f18a7c-0a2b-42f6-9f62-45283dfefc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f18a7c-0a2b-42f6-9f62-45283dfefc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '673b1561-e24a-4c60-9ea1-a9ea93d55bf9', 'volume_name': 'volume-673b1561-e24a-4c60-9ea1-a9ea93d55bf9', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a59c853-4632-491d-82df-e9ca76ab9840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a59c853-4632-491d-82df-e9ca76ab9840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5294f5e-5dd7-4a82-9321-edcd1b17985a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:05 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume 673b1561-e24a-4c60-9ea1-a9ea93d55bf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-673b1561-e24a-4c60-9ea1-a9ea93d55bf9', 'volume_size': 1} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:05 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-99524c58-0d76-49a6-ad54-09bd8344776d 1073741824" returned: 0 in 1.031s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-99524c58-0d76-49a6-ad54-09bd8344776d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:05 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-99524c58-0d76-49a6-ad54-09bd8344776d Jul 08 02:55:05 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Flow 'volume_create_manager' (e6b7d5be-7379-4600-8c92-8cec1d695dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2f6ead-0708-4b0b-ba7c-8ce5a6ab8160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2f6ead-0708-4b0b-ba7c-8ce5a6ab8160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1952188819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9bf59e-7d17-4aba-ad02-5c56efe8caba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27da98c8f28b4cc6b783804a7690a32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:55:06Z,use_quota=True,user_id='e582ac11e3d54862a9bbf2224b13b246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4443aa-4318-462c-a8b8-dcb071175e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4443aa-4318-462c-a8b8-dcb071175e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db99cdc-80c6-428f-abcc-d82327702a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db99cdc-80c6-428f-abcc-d82327702a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa9bf59e-7d17-4aba-ad02-5c56efe8caba', 'volume_name': 'volume-fa9bf59e-7d17-4aba-ad02-5c56efe8caba', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ec75f0-fa90-4179-964a-271b4ac1bdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ec75f0-fa90-4179-964a-271b4ac1bdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4579504-5e1a-44d4-8484-4ad398c2bec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:05 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume fa9bf59e-7d17-4aba-ad02-5c56efe8caba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa9bf59e-7d17-4aba-ad02-5c56efe8caba', 'volume_size': 1} Jul 08 02:55:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Flow 'volume_create_manager' (9411e446-18c7-4db0-b9b6-4d6b686cbe9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9358d88e-f705-4513-8d68-6ad0946ba9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9358d88e-f705-4513-8d68-6ad0946ba9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1267564347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54dba89c-b6bd-41c8-97db-9e61d648a563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27da98c8f28b4cc6b783804a7690a32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:55:06Z,use_quota=True,user_id='e582ac11e3d54862a9bbf2224b13b246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3ceabb-cdda-453a-a63c-934629a38bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3ceabb-cdda-453a-a63c-934629a38bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474e1e23-71a2-4383-a115-26aa88ce1e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474e1e23-71a2-4383-a115-26aa88ce1e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54dba89c-b6bd-41c8-97db-9e61d648a563', 'volume_name': 'volume-54dba89c-b6bd-41c8-97db-9e61d648a563', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6f816e-fda9-4ffc-83e4-c099e839a756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6f816e-fda9-4ffc-83e4-c099e839a756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3ecb86-c3c5-4c2d-8b6e-9f73ee6ccd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:06 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume 54dba89c-b6bd-41c8-97db-9e61d648a563: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54dba89c-b6bd-41c8-97db-9e61d648a563', 'volume_size': 1} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:06 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-99524c58-0d76-49a6-ad54-09bd8344776d" returned: 0 in 0.837s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.589s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1860873211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2178ff47-c4ec-4fe9-b673-61c5d0db3142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27da98c8f28b4cc6b783804a7690a32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:55:05Z,use_quota=True,user_id='e582ac11e3d54862a9bbf2224b13b246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Creating volume 2178ff47-c4ec-4fe9-b673-61c5d0db3142 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:55:06 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2178ff47-c4ec-4fe9-b673-61c5d0db3142 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:06 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2178ff47-c4ec-4fe9-b673-61c5d0db3142 1073741824 Jul 08 02:55:06 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a322521d-a8be-45de-8952-93ad3d6145a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99524c58-0d76-49a6-ad54-09bd8344776d', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30d4d8a-a0b7-476a-abdc-5bf462e327b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:06 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume volume-99524c58-0d76-49a6-ad54-09bd8344776d (99524c58-0d76-49a6-ad54-09bd8344776d): created successfully Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30d4d8a-a0b7-476a-abdc-5bf462e327b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:06 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Flow 'volume_create_manager' (58cb3ead-db16-42d0-9ef2-523b75c3c15f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:55:06 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-06b4d515-61c2-44b4-a3a2-6abefdd42b39 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Created volume successfully. Jul 08 02:55:07 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2178ff47-c4ec-4fe9-b673-61c5d0db3142 1073741824" returned: 0 in 0.979s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2178ff47-c4ec-4fe9-b673-61c5d0db3142 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:07 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2178ff47-c4ec-4fe9-b673-61c5d0db3142 Jul 08 02:55:07 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:08 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2178ff47-c4ec-4fe9-b673-61c5d0db3142" returned: 0 in 0.857s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.026s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-599683889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673b1561-e24a-4c60-9ea1-a9ea93d55bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27da98c8f28b4cc6b783804a7690a32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:55:05Z,use_quota=True,user_id='e582ac11e3d54862a9bbf2224b13b246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Creating volume 673b1561-e24a-4c60-9ea1-a9ea93d55bf9 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:55:08 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-673b1561-e24a-4c60-9ea1-a9ea93d55bf9 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9824e522-dd12-4366-a85e-95b5490e18dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2178ff47-c4ec-4fe9-b673-61c5d0db3142', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf0c6fe0-1c94-4a3d-a1c9-365fa9c6c5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:08 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-673b1561-e24a-4c60-9ea1-a9ea93d55bf9 1073741824 Jul 08 02:55:08 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:08 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume volume-2178ff47-c4ec-4fe9-b673-61c5d0db3142 (2178ff47-c4ec-4fe9-b673-61c5d0db3142): created successfully Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf0c6fe0-1c94-4a3d-a1c9-365fa9c6c5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Flow 'volume_create_manager' (2a423739-5c91-48ce-82ae-289b03fff1f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:55:08 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5323f5e1-46da-4d29-af51-4b99007b42fb tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Created volume successfully. Jul 08 02:55:09 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-673b1561-e24a-4c60-9ea1-a9ea93d55bf9 1073741824" returned: 0 in 0.956s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-673b1561-e24a-4c60-9ea1-a9ea93d55bf9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:09 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-673b1561-e24a-4c60-9ea1-a9ea93d55bf9 Jul 08 02:55:09 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:10 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-673b1561-e24a-4c60-9ea1-a9ea93d55bf9" returned: 0 in 0.696s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.246s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1952188819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9bf59e-7d17-4aba-ad02-5c56efe8caba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27da98c8f28b4cc6b783804a7690a32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:55:06Z,use_quota=True,user_id='e582ac11e3d54862a9bbf2224b13b246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Creating volume fa9bf59e-7d17-4aba-ad02-5c56efe8caba {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:55:10 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa9bf59e-7d17-4aba-ad02-5c56efe8caba 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:10 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa9bf59e-7d17-4aba-ad02-5c56efe8caba 1073741824 Jul 08 02:55:10 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5294f5e-5dd7-4a82-9321-edcd1b17985a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-673b1561-e24a-4c60-9ea1-a9ea93d55bf9', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f905458d-b3eb-4a01-bb2a-67b2cd55acb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:10 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume volume-673b1561-e24a-4c60-9ea1-a9ea93d55bf9 (673b1561-e24a-4c60-9ea1-a9ea93d55bf9): created successfully Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f905458d-b3eb-4a01-bb2a-67b2cd55acb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Flow 'volume_create_manager' (bf1d3212-717f-4c63-985f-a1918c9e8828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:55:10 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c500e465-527d-4a94-8a70-95d183bbf0b9 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Created volume successfully. Jul 08 02:55:11 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa9bf59e-7d17-4aba-ad02-5c56efe8caba 1073741824" returned: 0 in 0.927s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa9bf59e-7d17-4aba-ad02-5c56efe8caba {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:11 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa9bf59e-7d17-4aba-ad02-5c56efe8caba Jul 08 02:55:11 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:11 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa9bf59e-7d17-4aba-ad02-5c56efe8caba" returned: 0 in 0.666s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.488s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1267564347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54dba89c-b6bd-41c8-97db-9e61d648a563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27da98c8f28b4cc6b783804a7690a32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:55:06Z,use_quota=True,user_id='e582ac11e3d54862a9bbf2224b13b246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Creating volume 54dba89c-b6bd-41c8-97db-9e61d648a563 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:55:11 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54dba89c-b6bd-41c8-97db-9e61d648a563 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4579504-5e1a-44d4-8484-4ad398c2bec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa9bf59e-7d17-4aba-ad02-5c56efe8caba', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:11 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54dba89c-b6bd-41c8-97db-9e61d648a563 1073741824 Jul 08 02:55:11 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796cc482-9620-45c4-a6fa-72035c8fac80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:11 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume volume-fa9bf59e-7d17-4aba-ad02-5c56efe8caba (fa9bf59e-7d17-4aba-ad02-5c56efe8caba): created successfully Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796cc482-9620-45c4-a6fa-72035c8fac80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Flow 'volume_create_manager' (e6b7d5be-7379-4600-8c92-8cec1d695dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:55:11 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-62830d64-3ec0-4be7-b4be-43a986a6c525 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Created volume successfully. Jul 08 02:55:12 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54dba89c-b6bd-41c8-97db-9e61d648a563 1073741824" returned: 0 in 0.836s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54dba89c-b6bd-41c8-97db-9e61d648a563 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:12 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54dba89c-b6bd-41c8-97db-9e61d648a563 Jul 08 02:55:12 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Acquiring lock "cinder-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Lock "cinder-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Acquiring lock "cinder-quobyte-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Lock "cinder-quobyte-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32" acquired by "delete_volume" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f237e2e6-3712-4d14-b420-c38135bf34ed]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:13 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32 Jul 08 02:55:13 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:13 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54dba89c-b6bd-41c8-97db-9e61d648a563" returned: 0 in 0.701s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3ecb86-c3c5-4c2d-8b6e-9f73ee6ccd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54dba89c-b6bd-41c8-97db-9e61d648a563', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76c7641-ffcb-4be1-8f3b-e919caf07288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:13 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Volume volume-54dba89c-b6bd-41c8-97db-9e61d648a563 (54dba89c-b6bd-41c8-97db-9e61d648a563): created successfully Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76c7641-ffcb-4be1-8f3b-e919caf07288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Flow 'volume_create_manager' (9411e446-18c7-4db0-b9b6-4d6b686cbe9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:55:13 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f297a84b-e43b-46ea-b90d-e9b5abe36cc7 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Created volume successfully. Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "cinder-54dba89c-b6bd-41c8-97db-9e61d648a563-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-54dba89c-b6bd-41c8-97db-9e61d648a563-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:13 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32" returned: 0 in 0.819s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:13 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32 Jul 08 02:55:13 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "cinder-quobyte-54dba89c-b6bd-41c8-97db-9e61d648a563" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-quobyte-54dba89c-b6bd-41c8-97db-9e61d648a563" acquired by "delete_volume" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a5f51c-fd20-476f-98fc-1eed37990ae3]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:55:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54dba89c-b6bd-41c8-97db-9e61d648a563 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:14 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54dba89c-b6bd-41c8-97db-9e61d648a563 Jul 08 02:55:14 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:14 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32" returned: 0 in 0.698s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Lock "cinder-quobyte-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32" released by "delete_volume" :: held 1.564s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:14 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Created reservations ['771af87b-9db8-45fd-b790-a56435cae55f', 'b171bc2d-c8fe-4932-82e5-e04fa4ebbba2', 'bae2062d-15e0-4860-b71e-866684e4e5e9', 'ee0d1cd5-751e-47d3-990e-fc20943c2f05'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:55:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:14 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:55:14 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:14 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54dba89c-b6bd-41c8-97db-9e61d648a563" returned: 0 in 0.808s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54dba89c-b6bd-41c8-97db-9e61d648a563 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:14 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54dba89c-b6bd-41c8-97db-9e61d648a563 Jul 08 02:55:14 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:15 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.746s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:55:15 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Deleted volume successfully. Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-61adaaa3-816a-421b-9e1b-95953065510e tempest-TestStampPattern-1115741669 None] Lock "cinder-03e2cc18-11a2-4cfb-8624-d8b8ad72bc32-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:15 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-54dba89c-b6bd-41c8-97db-9e61d648a563" returned: 0 in 0.723s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-quobyte-54dba89c-b6bd-41c8-97db-9e61d648a563" released by "delete_volume" :: held 1.571s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Acquiring lock "cinder-6ac27953-b8fb-4b86-9c85-8133b2183b9d-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Lock "cinder-6ac27953-b8fb-4b86-9c85-8133b2183b9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Acquiring lock "cinder-quobyte-75d4cc5d-0630-4908-86b6-0fd1d234ba53" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Lock "cinder-quobyte-75d4cc5d-0630-4908-86b6-0fd1d234ba53" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Acquiring lock "cinder-quobyte-6ac27953-b8fb-4b86-9c85-8133b2183b9d" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Lock "cinder-quobyte-6ac27953-b8fb-4b86-9c85-8133b2183b9d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Deleting offline snapshot 6ac27953-b8fb-4b86-9c85-8133b2183b9d of volume 75d4cc5d-0630-4908-86b6-0fd1d234ba53 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] snapshot_file for this snap is: volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Created reservations ['1376fa2a-6c0f-42c8-be47-5a61ed9f5d37', 'a5818bfa-4f40-48d0-bd87-fde97d69058c', '673a671e-d48c-448c-a3a4-5f9e6930d207', '5bfcc46a-f667-4bfe-acaa-21fd820c028b'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[be200d70-7f62-404d-ae0d-303063fe1399]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:15 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:55:15 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:15 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d Jul 08 02:55:15 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "cinder-fa9bf59e-7d17-4aba-ad02-5c56efe8caba-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-fa9bf59e-7d17-4aba-ad02-5c56efe8caba-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "cinder-quobyte-fa9bf59e-7d17-4aba-ad02-5c56efe8caba" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-quobyte-fa9bf59e-7d17-4aba-ad02-5c56efe8caba" acquired by "delete_volume" :: waited 0.034s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:16 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[281f30aa-c56e-475f-a573-7a649a9d4223]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:55:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa9bf59e-7d17-4aba-ad02-5c56efe8caba {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:16 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa9bf59e-7d17-4aba-ad02-5c56efe8caba Jul 08 02:55:16 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:16 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d" returned: 0 in 0.860s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:55:16 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:16 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[8108b9e5-d6d3-488b-ade6-08a862f7911a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:55:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.822s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:16 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:55:16 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Deleted volume successfully. Jul 08 02:55:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b847ea11-43cf-4a92-9e3b-e15876bbf42d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-54dba89c-b6bd-41c8-97db-9e61d648a563-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:16 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 Jul 08 02:55:16 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:17 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa9bf59e-7d17-4aba-ad02-5c56efe8caba" returned: 0 in 0.836s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa9bf59e-7d17-4aba-ad02-5c56efe8caba {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:17 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa9bf59e-7d17-4aba-ad02-5c56efe8caba Jul 08 02:55:17 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:17 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53" returned: 0 in 0.798s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:17 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d Jul 08 02:55:17 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:17 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa9bf59e-7d17-4aba-ad02-5c56efe8caba" returned: 0 in 0.647s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-quobyte-fa9bf59e-7d17-4aba-ad02-5c56efe8caba" released by "delete_volume" :: held 1.562s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:17 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Created reservations ['4bb49bc3-8453-476e-a61f-126244a83e96', 'b29193a2-1da6-47b8-bdfd-8f07d3e25c5e', 'eaf2e9eb-67e4-4376-89eb-9e7478909753', '87697d9f-9166-4b71-a108-81a9bffbd31f'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:55:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:17 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:55:17 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:18 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d" returned: 0 in 0.732s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:18 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d Jul 08 02:55:18 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "cinder-673b1561-e24a-4c60-9ea1-a9ea93d55bf9-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-673b1561-e24a-4c60-9ea1-a9ea93d55bf9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "cinder-quobyte-673b1561-e24a-4c60-9ea1-a9ea93d55bf9" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-quobyte-673b1561-e24a-4c60-9ea1-a9ea93d55bf9" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:18 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[40880aa4-4288-4f08-9685-d5d34deadf16]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:55:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-673b1561-e24a-4c60-9ea1-a9ea93d55bf9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:18 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.687s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:18 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:55:18 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Deleted volume successfully. Jul 08 02:55:18 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-673b1561-e24a-4c60-9ea1-a9ea93d55bf9 Jul 08 02:55:18 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e3d299e3-6c65-4e2a-8971-2bc6718afb8c tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-fa9bf59e-7d17-4aba-ad02-5c56efe8caba-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:18 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53.6ac27953-b8fb-4b86-9c85-8133b2183b9d" returned: 0 in 0.734s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Lock "cinder-quobyte-6ac27953-b8fb-4b86-9c85-8133b2183b9d" released by "_delete_snapshot" :: held 3.229s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Lock "cinder-quobyte-75d4cc5d-0630-4908-86b6-0fd1d234ba53" released by "delete_snapshot" :: held 3.261s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:18 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Created reservations ['d8b0100e-338a-4cb9-8c56-2487a7be4246', 'b0935ad9-6ac6-4c43-97f4-06c3defbe525', 'dac72b58-6706-48c6-a39d-d81ec6531070', '6d6edc7c-fad2-4706-83ad-3e432fc390ce'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:55:18 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Delete snapshot completed successfully. Jul 08 02:55:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-84b8e453-fbd8-41b8-bcc6-a0d7081b4bc8 tempest-TestStampPattern-1115741669 None] Lock "cinder-6ac27953-b8fb-4b86-9c85-8133b2183b9d-delete_snapshot" released by "delete_snapshot" :: held 3.416s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:19 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-673b1561-e24a-4c60-9ea1-a9ea93d55bf9" returned: 0 in 0.841s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-673b1561-e24a-4c60-9ea1-a9ea93d55bf9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:19 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-673b1561-e24a-4c60-9ea1-a9ea93d55bf9 Jul 08 02:55:19 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:20 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-673b1561-e24a-4c60-9ea1-a9ea93d55bf9" returned: 0 in 0.639s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-quobyte-673b1561-e24a-4c60-9ea1-a9ea93d55bf9" released by "delete_volume" :: held 1.528s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=92,cinder:UPDATE=126,cinder:DELETE=16,cinder:INSERT=26 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=122,cinder:SELECT=93,cinder:INSERT=31,cinder:DELETE=7 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Created reservations ['5338c6f9-31a5-40ff-9fd6-e8454ab4c1de', '3a03c525-94c6-4f09-a1f8-770c806f0d2d', 'ed523504-88af-42fd-bdd6-1ecef25a45fa', 'e9a184a8-e16f-4a7f-8809-5bf6ac4f7045'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:20 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:55:20 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "cinder-2178ff47-c4ec-4fe9-b673-61c5d0db3142-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-2178ff47-c4ec-4fe9-b673-61c5d0db3142-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "cinder-quobyte-2178ff47-c4ec-4fe9-b673-61c5d0db3142" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-quobyte-2178ff47-c4ec-4fe9-b673-61c5d0db3142" acquired by "delete_volume" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fb73c2-1225-49c4-9b79-15ba35f3ce15]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2178ff47-c4ec-4fe9-b673-61c5d0db3142 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:20 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.745s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:55:20 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Deleted volume successfully. Jul 08 02:55:20 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2178ff47-c4ec-4fe9-b673-61c5d0db3142 Jul 08 02:55:20 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c920a29a-246f-4e57-94a1-46cd0e284c4d tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-673b1561-e24a-4c60-9ea1-a9ea93d55bf9-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:21 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2178ff47-c4ec-4fe9-b673-61c5d0db3142" returned: 0 in 0.784s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2178ff47-c4ec-4fe9-b673-61c5d0db3142 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:21 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2178ff47-c4ec-4fe9-b673-61c5d0db3142 Jul 08 02:55:21 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:22 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2178ff47-c4ec-4fe9-b673-61c5d0db3142" returned: 0 in 0.688s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:22 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-quobyte-2178ff47-c4ec-4fe9-b673-61c5d0db3142" released by "delete_volume" :: held 1.519s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:22 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Created reservations ['83804f66-a6ea-4bb6-a706-37d730dfc004', '4034bdf1-2356-4d86-aa57-b9116317586d', 'a3d0e514-a952-42f0-bc1b-e8841006aa2a', '6355d265-a828-4b8c-802d-52953fe3cac6'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:55:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:22 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:55:22 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:22 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "cinder-99524c58-0d76-49a6-ad54-09bd8344776d-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:22 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-99524c58-0d76-49a6-ad54-09bd8344776d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "cinder-quobyte-99524c58-0d76-49a6-ad54-09bd8344776d" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-quobyte-99524c58-0d76-49a6-ad54-09bd8344776d" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:23 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd58e6c8-b780-40c6-a807-8b34935f3d48]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:55:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-99524c58-0d76-49a6-ad54-09bd8344776d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:23 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-99524c58-0d76-49a6-ad54-09bd8344776d Jul 08 02:55:23 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:23 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.849s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:23 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:55:23 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Deleted volume successfully. Jul 08 02:55:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a2f2a95c-aeb2-4f91-9c6c-02bda6f0c5b6 tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-2178ff47-c4ec-4fe9-b673-61c5d0db3142-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:23 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-99524c58-0d76-49a6-ad54-09bd8344776d" returned: 0 in 0.862s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-99524c58-0d76-49a6-ad54-09bd8344776d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:23 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-99524c58-0d76-49a6-ad54-09bd8344776d Jul 08 02:55:23 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:24 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-99524c58-0d76-49a6-ad54-09bd8344776d" returned: 0 in 0.656s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-quobyte-99524c58-0d76-49a6-ad54-09bd8344776d" released by "delete_volume" :: held 1.564s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:24 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Created reservations ['a34e6f8f-f912-4ff4-aae7-6cdc7b6b4623', '6185b4d2-b318-4ad8-a526-e0681325a4da', '2eace8d3-0b06-4a94-a18b-e689108074fa', '1f9da3f4-b71d-4ed6-8366-172e9ad21102'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:55:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:24 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:55:24 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "cinder-8e340dfc-2e8a-406c-b287-d5210335b190-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-8e340dfc-2e8a-406c-b287-d5210335b190-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "cinder-quobyte-8e340dfc-2e8a-406c-b287-d5210335b190" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-quobyte-8e340dfc-2e8a-406c-b287-d5210335b190" acquired by "delete_volume" :: waited 0.033s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:25 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91f0868-49c1-4638-ac05-7c3e2744ce95]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:55:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e340dfc-2e8a-406c-b287-d5210335b190 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:25 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.678s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:25 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:55:25 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Deleted volume successfully. Jul 08 02:55:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-57f95f68-3ef5-4a4b-854e-cfbfcfe693ab tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-99524c58-0d76-49a6-ad54-09bd8344776d-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:25 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e340dfc-2e8a-406c-b287-d5210335b190 Jul 08 02:55:25 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:26 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e340dfc-2e8a-406c-b287-d5210335b190" returned: 0 in 0.774s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e340dfc-2e8a-406c-b287-d5210335b190 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:26 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e340dfc-2e8a-406c-b287-d5210335b190 Jul 08 02:55:26 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:26 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8e340dfc-2e8a-406c-b287-d5210335b190" returned: 0 in 0.622s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-quobyte-8e340dfc-2e8a-406c-b287-d5210335b190" released by "delete_volume" :: held 1.438s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:26 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Created reservations ['ab727ab8-c6b1-4570-b67e-1d98815c4cce', '1e4e2c28-022a-492d-9e7d-76833dfb9568', '30a9fe64-5b81-46e6-8a1c-4dfcf673db73', 'b19a94ee-ff28-4ec2-8caf-2017676cb57b'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:55:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:26 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:55:26 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:27 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.679s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:27 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:55:27 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Deleted volume successfully. Jul 08 02:55:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-3b4bda44-b770-4920-a578-ace91bcda38f tempest-CreateVolumesFromSourceVolumeTest-2006445025 None] Lock "cinder-8e340dfc-2e8a-406c-b287-d5210335b190-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Acquiring lock "cinder-75d4cc5d-0630-4908-86b6-0fd1d234ba53-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Lock "cinder-75d4cc5d-0630-4908-86b6-0fd1d234ba53-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Acquiring lock "cinder-quobyte-75d4cc5d-0630-4908-86b6-0fd1d234ba53" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Lock "cinder-quobyte-75d4cc5d-0630-4908-86b6-0fd1d234ba53" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:28 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5835d2-209a-4bd3-82b7-d1bfa5d4f94b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:55:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:28 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 Jul 08 02:55:28 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:29 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53" returned: 0 in 0.830s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:29 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53 Jul 08 02:55:29 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:29 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-75d4cc5d-0630-4908-86b6-0fd1d234ba53" returned: 0 in 0.674s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Lock "cinder-quobyte-75d4cc5d-0630-4908-86b6-0fd1d234ba53" released by "delete_volume" :: held 1.578s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:29 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Created reservations ['aafe5406-e07a-4804-bf70-1e8c84da97b7', '0330ec35-b4de-4fe3-adf5-3453f451a7b6', '0346c567-0fea-43f0-b141-edf9cc63982b', '10852e4e-68c7-48fe-8311-22a83cf0383f'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:55:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:30 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:55:30 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:30 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.761s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:30 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:55:30 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Deleted volume successfully. Jul 08 02:55:30 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-658b59ce-73c9-4fc4-807f-39ff106312d4 tempest-TestStampPattern-1115741669 None] Lock "cinder-75d4cc5d-0630-4908-86b6-0fd1d234ba53-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:39 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=24,cinder:INSERT=8,cinder:UPDATE=45,cinder:DELETE=3 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:55:40 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:INSERT=12,cinder:UPDATE=34,cinder:SELECT=22,cinder:DELETE=2 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:55:43 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:55:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Flow 'volume_create_manager' (a6ab1bff-0344-408a-aaa3-8cc21fcafa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:55:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21dc571-dd7a-497c-81e1-dd0eed3c7103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21dc571-dd7a-497c-81e1-dd0eed3c7103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dc7fe1-ee41-4159-b1a8-835f76ae0fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09f34fc18bb044f0a92553e59114d5d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:55:44Z,use_quota=True,user_id='7031994618944b7b8f78e597d47731a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68bc3a0-ae81-44c1-a340-9fb3e0f694d2),volume_type_id=d68bc3a0-ae81-44c1-a340-9fb3e0f694d2)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67348011-42cd-40ee-b3bf-77f100ed39b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67348011-42cd-40ee-b3bf-77f100ed39b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c15a0e-a616-4840-b6de-52fc042dfead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:43 devstack cinder-volume[87238]: DEBUG cinder.image.glance [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Creating Keystone auth plugin from conf {{(pid=87238) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 02:55:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c15a0e-a616-4840-b6de-52fc042dfead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45dc7fe1-ee41-4159-b1a8-835f76ae0fe9', 'volume_name': 'volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9', 'volume_size': 1, 'image_id': '8ec6c5da-c4a3-4ded-a5cb-f6e803596128', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ec6c5da-c4a3-4ded-a5cb-f6e803596128', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '30cfa283c3f88849a55c49f6363d5a60', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09f34fc18bb044f0a92553e59114d5d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '427771914e5db2a868917ec2be8e2fbc3c55184a485f33ca25df48784dc9384075514f8f497503ccb8b9d2d17c0242e58bda2e08f5b77be6751ff14e091afbfd', 'id': '8ec6c5da-c4a3-4ded-a5cb-f6e803596128', 'created_at': datetime.datetime(2026, 7, 8, 0, 55, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ec6c5da-c4a3-4ded-a5cb-f6e803596128/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4974dfea-8d30-4029-abd6-f6d91f2eae2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4974dfea-8d30-4029-abd6-f6d91f2eae2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdb5864-180b-4847-894d-ebbca7a06e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:44 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Volume 45dc7fe1-ee41-4159-b1a8-835f76ae0fe9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9', 'volume_size': 1, 'image_id': '8ec6c5da-c4a3-4ded-a5cb-f6e803596128', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ec6c5da-c4a3-4ded-a5cb-f6e803596128', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '30cfa283c3f88849a55c49f6363d5a60', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09f34fc18bb044f0a92553e59114d5d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '427771914e5db2a868917ec2be8e2fbc3c55184a485f33ca25df48784dc9384075514f8f497503ccb8b9d2d17c0242e58bda2e08f5b77be6751ff14e091afbfd', 'id': '8ec6c5da-c4a3-4ded-a5cb-f6e803596128', 'created_at': datetime.datetime(2026, 7, 8, 0, 55, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ec6c5da-c4a3-4ded-a5cb-f6e803596128/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 02:55:44 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Trying to clone 45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 from image 8ec6c5da-c4a3-4ded-a5cb-f6e803596128 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8ec6c5da-c4a3-4ded-a5cb-f6e803596128', 'metadata': {}}]). {{(pid=87238) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 02:55:44 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 02:55:44 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Image download 0.00 MB at 0.00 MB/s Jul 08 02:55:44 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc304546-fe55-4b16-b1e5-f36f93974dfa]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:55:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:44 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD Jul 08 02:55:44 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:45 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD" returned: 0 in 0.718s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:45 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD Jul 08 02:55:45 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:45 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD" returned: 1 in 0.702s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:55:45 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Temporary image 8ec6c5da-c4a3-4ded-a5cb-f6e803596128 is fetched for user 7031994618944b7b8f78e597d47731a6. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 02:55:45 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad7e8bd-41b0-4310-92ca-6bc9cbce7731]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:55:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:45 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD Jul 08 02:55:45 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:46 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD" returned: 0 in 0.721s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:46 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD Jul 08 02:55:46 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:47 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD" returned: 1 in 0.707s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dc7fe1-ee41-4159-b1a8-835f76ae0fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09f34fc18bb044f0a92553e59114d5d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:55:44Z,use_quota=True,user_id='7031994618944b7b8f78e597d47731a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68bc3a0-ae81-44c1-a340-9fb3e0f694d2),volume_type_id=d68bc3a0-ae81-44c1-a340-9fb3e0f694d2)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Creating volume 45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:55:47 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:47 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 1073741824 Jul 08 02:55:47 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:47 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:55:47 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:47 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.664s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:55:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:55:48 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 1073741824" returned: 0 in 0.819s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:48 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 Jul 08 02:55:48 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:48 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9" returned: 0 in 0.633s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:55:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:48 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Attempting download of 8ec6c5da-c4a3-4ded-a5cb-f6e803596128 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ec6c5da-c4a3-4ded-a5cb-f6e803596128', 'metadata': {}}])) to volume 45dc7fe1-ee41-4159-b1a8-835f76ae0fe9. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 02:55:48 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd376762-66d5-449c-ba40-3af6384b0f19]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:55:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_tcbkwzud {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:48 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_tcbkwzud Jul 08 02:55:48 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:49 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_tcbkwzud" returned: 0 in 0.716s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_tcbkwzud {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:49 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_tcbkwzud Jul 08 02:55:49 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:50 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_tcbkwzud" returned: 1 in 0.712s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_tcbkwzud' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:55:50 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[17808274-d27e-41be-853f-e07e06e8e755]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:55:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:50 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD Jul 08 02:55:50 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:50 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD" returned: 0 in 0.706s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:51 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD Jul 08 02:55:51 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:51 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD" returned: 1 in 0.699s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:55:51 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] 8ec6c5da-c4a3-4ded-a5cb-f6e803596128 was raw, converting to raw {{(pid=87238) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 02:55:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:51 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 Jul 08 02:55:51 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:52 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9" returned: 0 in 0.710s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:52 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8ec6c5da-c4a3-4ded-a5cb-f6e803596128_rtzaf13gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:55:52 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 02:55:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:52 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 1G Jul 08 02:55:52 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:53 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 1G" returned: 0 in 0.677s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:53 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7b2af4-3f1a-4a95-975c-9dcbcd7e696b]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:55:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:53 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 Jul 08 02:55:53 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:53 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9" returned: 0 in 0.724s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:53 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 Jul 08 02:55:53 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:54 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9" returned: 1 in 0.746s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:55:54 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Downloaded image 8ec6c5da-c4a3-4ded-a5cb-f6e803596128 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ec6c5da-c4a3-4ded-a5cb-f6e803596128', 'metadata': {}}])) to volume 45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 successfully. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 02:55:54 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Temporary image 8ec6c5da-c4a3-4ded-a5cb-f6e803596128 for user 7031994618944b7b8f78e597d47731a6 is deleted. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 02:55:54 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Marking volume 45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 as bootable. {{(pid=87238) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 02:55:54 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Copying metadata from image 8ec6c5da-c4a3-4ded-a5cb-f6e803596128 to 45dc7fe1-ee41-4159-b1a8-835f76ae0fe9. {{(pid=87238) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 02:55:54 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Creating volume glance metadata for volume 45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 backed by image 8ec6c5da-c4a3-4ded-a5cb-f6e803596128 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8ec6c5da-c4a3-4ded-a5cb-f6e803596128', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '30cfa283c3f88849a55c49f6363d5a60', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87238) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 02:55:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdb5864-180b-4847-894d-ebbca7a06e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9', 'volume_size': 1, 'image_id': '8ec6c5da-c4a3-4ded-a5cb-f6e803596128', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ec6c5da-c4a3-4ded-a5cb-f6e803596128', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '30cfa283c3f88849a55c49f6363d5a60', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09f34fc18bb044f0a92553e59114d5d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '427771914e5db2a868917ec2be8e2fbc3c55184a485f33ca25df48784dc9384075514f8f497503ccb8b9d2d17c0242e58bda2e08f5b77be6751ff14e091afbfd', 'id': '8ec6c5da-c4a3-4ded-a5cb-f6e803596128', 'created_at': datetime.datetime(2026, 7, 8, 0, 55, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ec6c5da-c4a3-4ded-a5cb-f6e803596128/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59698ea-643e-45a3-b475-fb6d9b2daf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:55:54 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Volume volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 (45dc7fe1-ee41-4159-b1a8-835f76ae0fe9): created successfully Jul 08 02:55:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59698ea-643e-45a3-b475-fb6d9b2daf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:55:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Flow 'volume_create_manager' (a6ab1bff-0344-408a-aaa3-8cc21fcafa92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:55:54 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e87bf6e8-baea-40d0-a11b-4f8bb567d893 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Created volume successfully. Jul 08 02:55:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Acquiring lock "cinder-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Lock "cinder-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Acquiring lock "cinder-quobyte-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:55:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Lock "cinder-quobyte-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9" acquired by "delete_volume" :: waited 0.013s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:55:55 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef55b27-5e77-456f-8dc9-826059bec640]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:55:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:55 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 Jul 08 02:55:55 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:56 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9" returned: 0 in 0.748s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:56 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 Jul 08 02:55:56 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:57 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9" returned: 1 in 0.749s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:55:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:57 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9 Jul 08 02:55:57 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:57 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9" returned: 0 in 0.638s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Lock "cinder-quobyte-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9" released by "delete_volume" :: held 2.193s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:55:57 devstack cinder-volume[87238]: WARNING cinder.quota [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:55:57 devstack cinder-volume[87238]: WARNING cinder.quota [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:55:57 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Created reservations ['f5459f91-69d1-44c0-b08f-c9bbf210a892', '0dc77e41-a128-4da7-814d-e4f67b264fdf', 'ce52c92a-ac75-46ab-9c93-05d64a03cbc9', 'e8c003c8-7368-412c-a373-850ee51fcabb'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:55:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:55:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:55:57 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:55:57 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:55:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:55:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:55:57 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:55:57 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:55:58 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jul 08 02:55:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.642s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:55:58 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:55:58 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Deleted volume successfully. Jul 08 02:55:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b714a7b2-de53-4adc-8292-40e749d484c1 tempest-VolumeAndVolumeTypeFromImageTest-730612243 None] Lock "cinder-45dc7fe1-ee41-4159-b1a8-835f76ae0fe9-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:56:04 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:56:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Flow 'volume_create_manager' (7ebb3db9-7ae5-47a7-883d-ea651fff4e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:56:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817a97be-7251-4710-98d6-3afd59f40e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817a97be-7251-4710-98d6-3afd59f40e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03e8acb-c8d7-489a-98ae-23fe200a9545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34840a512d074145ab3fcd865bf770a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:56:05Z,use_quota=True,user_id='0d3db34b66994a16be74f34be4b74e6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae91fa0-6542-43f3-ba58-4e02b3579f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae91fa0-6542-43f3-ba58-4e02b3579f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d281f0-c831-49d5-8785-0258075dc0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:04 devstack cinder-volume[87238]: DEBUG cinder.image.glance [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Creating Keystone auth plugin from conf {{(pid=87238) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 02:56:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d281f0-c831-49d5-8785-0258075dc0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd03e8acb-c8d7-489a-98ae-23fe200a9545', 'volume_name': 'volume-d03e8acb-c8d7-489a-98ae-23fe200a9545', 'volume_size': 1, 'image_id': '29570230-6637-4c57-b9bf-dafc1451d50c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29570230-6637-4c57-b9bf-dafc1451d50c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1fba3e4ef488546ef3effcf130cb378', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34840a512d074145ab3fcd865bf770a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e21ccf6167441945fa18cd18d42dba87985464ded0c3e7123001a5924f45b95740b67250c820e05fd3f96a2de7b84a5915e91b8ea58f9c08a7428b5a50dc0688', 'id': '29570230-6637-4c57-b9bf-dafc1451d50c', 'created_at': datetime.datetime(2026, 7, 8, 0, 56, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 56, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29570230-6637-4c57-b9bf-dafc1451d50c/file', 'properties': {}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa0a449-0843-4276-aacc-1878e339830e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa0a449-0843-4276-aacc-1878e339830e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f215f3f-1ecf-4b95-8d38-132f791d0b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:05 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Volume d03e8acb-c8d7-489a-98ae-23fe200a9545: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d03e8acb-c8d7-489a-98ae-23fe200a9545', 'volume_size': 1, 'image_id': '29570230-6637-4c57-b9bf-dafc1451d50c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29570230-6637-4c57-b9bf-dafc1451d50c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1fba3e4ef488546ef3effcf130cb378', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34840a512d074145ab3fcd865bf770a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e21ccf6167441945fa18cd18d42dba87985464ded0c3e7123001a5924f45b95740b67250c820e05fd3f96a2de7b84a5915e91b8ea58f9c08a7428b5a50dc0688', 'id': '29570230-6637-4c57-b9bf-dafc1451d50c', 'created_at': datetime.datetime(2026, 7, 8, 0, 56, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 56, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29570230-6637-4c57-b9bf-dafc1451d50c/file', 'properties': {}}, 'image_service': } Jul 08 02:56:05 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Trying to clone d03e8acb-c8d7-489a-98ae-23fe200a9545 from image 29570230-6637-4c57-b9bf-dafc1451d50c at location (None, [{'url': 'file:///opt/stack/data/glance/images/29570230-6637-4c57-b9bf-dafc1451d50c', 'metadata': {}}]). {{(pid=87238) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 02:56:05 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 02:56:05 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Image download 0.00 MB at 0.00 MB/s Jul 08 02:56:05 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cee59b-172d-4c17-b1c0-16196834afbe]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:56:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:05 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD Jul 08 02:56:05 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:05 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD" returned: 0 in 0.722s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:06 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD Jul 08 02:56:06 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:06 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD" returned: 1 in 0.754s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:56:06 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Temporary image 29570230-6637-4c57-b9bf-dafc1451d50c is fetched for user 0d3db34b66994a16be74f34be4b74e6f. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 02:56:06 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ae582f-bc9e-45cf-af74-8b2cf3458247]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:56:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:06 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD Jul 08 02:56:06 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:07 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD" returned: 0 in 0.729s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:07 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD Jul 08 02:56:07 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:08 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD" returned: 1 in 0.712s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:56:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03e8acb-c8d7-489a-98ae-23fe200a9545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34840a512d074145ab3fcd865bf770a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:56:05Z,use_quota=True,user_id='0d3db34b66994a16be74f34be4b74e6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:56:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Creating volume d03e8acb-c8d7-489a-98ae-23fe200a9545 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:56:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:56:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:56:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:56:08 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:56:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:08 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 1073741824 Jul 08 02:56:08 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:09 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 1073741824" returned: 0 in 0.793s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:09 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 Jul 08 02:56:09 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:09 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545" returned: 0 in 0.630s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:56:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:09 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Attempting download of 29570230-6637-4c57-b9bf-dafc1451d50c ((None, [{'url': 'file:///opt/stack/data/glance/images/29570230-6637-4c57-b9bf-dafc1451d50c', 'metadata': {}}])) to volume d03e8acb-c8d7-489a-98ae-23fe200a9545. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 02:56:09 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9349be9-9a0d-4357-b94a-bab6f6bb24a9]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:56:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29570230-6637-4c57-b9bf-dafc1451d50c_3pn6fz25 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:09 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29570230-6637-4c57-b9bf-dafc1451d50c_3pn6fz25 Jul 08 02:56:09 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:10 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29570230-6637-4c57-b9bf-dafc1451d50c_3pn6fz25" returned: 0 in 0.723s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29570230-6637-4c57-b9bf-dafc1451d50c_3pn6fz25 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:10 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29570230-6637-4c57-b9bf-dafc1451d50c_3pn6fz25 Jul 08 02:56:10 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:11 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29570230-6637-4c57-b9bf-dafc1451d50c_3pn6fz25" returned: 1 in 0.712s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29570230-6637-4c57-b9bf-dafc1451d50c_3pn6fz25' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:56:11 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6493504-912c-4c24-90c2-c366e1106a8a]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:56:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:11 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD Jul 08 02:56:11 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:11 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD" returned: 0 in 0.708s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:12 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD Jul 08 02:56:12 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:12 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD" returned: 1 in 0.709s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:56:12 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] 29570230-6637-4c57-b9bf-dafc1451d50c was raw, converting to raw {{(pid=87238) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 02:56:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:12 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 Jul 08 02:56:12 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:13 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545" returned: 0 in 0.725s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:13 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_29570230-6637-4c57-b9bf-dafc1451d50c_ae9sngakdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:56:13 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 02:56:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:13 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 1G Jul 08 02:56:13 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:14 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 1G" returned: 0 in 0.665s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:14 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ae0fb3-d9ad-4e49-9b4a-e05a072fc561]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:56:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:14 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 Jul 08 02:56:14 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:14 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545" returned: 0 in 0.727s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:14 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 Jul 08 02:56:14 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:15 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545" returned: 1 in 0.755s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:56:15 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Downloaded image 29570230-6637-4c57-b9bf-dafc1451d50c ((None, [{'url': 'file:///opt/stack/data/glance/images/29570230-6637-4c57-b9bf-dafc1451d50c', 'metadata': {}}])) to volume d03e8acb-c8d7-489a-98ae-23fe200a9545 successfully. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 02:56:15 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Temporary image 29570230-6637-4c57-b9bf-dafc1451d50c for user 0d3db34b66994a16be74f34be4b74e6f is deleted. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 02:56:15 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Marking volume d03e8acb-c8d7-489a-98ae-23fe200a9545 as bootable. {{(pid=87238) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 02:56:15 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Copying metadata from image 29570230-6637-4c57-b9bf-dafc1451d50c to d03e8acb-c8d7-489a-98ae-23fe200a9545. {{(pid=87238) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 02:56:15 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Creating volume glance metadata for volume d03e8acb-c8d7-489a-98ae-23fe200a9545 backed by image 29570230-6637-4c57-b9bf-dafc1451d50c with: {'image_id': '29570230-6637-4c57-b9bf-dafc1451d50c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e1fba3e4ef488546ef3effcf130cb378', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87238) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 02:56:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f215f3f-1ecf-4b95-8d38-132f791d0b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03e8acb-c8d7-489a-98ae-23fe200a9545', 'volume_size': 1, 'image_id': '29570230-6637-4c57-b9bf-dafc1451d50c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29570230-6637-4c57-b9bf-dafc1451d50c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1fba3e4ef488546ef3effcf130cb378', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34840a512d074145ab3fcd865bf770a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e21ccf6167441945fa18cd18d42dba87985464ded0c3e7123001a5924f45b95740b67250c820e05fd3f96a2de7b84a5915e91b8ea58f9c08a7428b5a50dc0688', 'id': '29570230-6637-4c57-b9bf-dafc1451d50c', 'created_at': datetime.datetime(2026, 7, 8, 0, 56, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 56, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29570230-6637-4c57-b9bf-dafc1451d50c/file', 'properties': {}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc389a5f-e164-4b87-adf6-b68ca3713f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:15 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Volume volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 (d03e8acb-c8d7-489a-98ae-23fe200a9545): created successfully Jul 08 02:56:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc389a5f-e164-4b87-adf6-b68ca3713f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Flow 'volume_create_manager' (7ebb3db9-7ae5-47a7-883d-ea651fff4e53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:56:15 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-4e313ed2-9f25-4ee2-bde8-d77458f676d8 tempest-VolumeImageDependencyTests-1300869532 None] Created volume successfully. Jul 08 02:56:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Acquiring lock "cinder-d03e8acb-c8d7-489a-98ae-23fe200a9545-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Lock "cinder-d03e8acb-c8d7-489a-98ae-23fe200a9545-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Acquiring lock "cinder-quobyte-d03e8acb-c8d7-489a-98ae-23fe200a9545" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Lock "cinder-quobyte-d03e8acb-c8d7-489a-98ae-23fe200a9545" acquired by "delete_volume" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:16 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[756fd368-1163-40f2-80e5-1a2bd37d058b]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:56:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:16 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 Jul 08 02:56:16 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:17 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545" returned: 0 in 0.732s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:17 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 Jul 08 02:56:17 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:18 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545" returned: 1 in 0.729s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:56:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:18 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545 Jul 08 02:56:18 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:18 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d03e8acb-c8d7-489a-98ae-23fe200a9545" returned: 0 in 0.634s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Lock "cinder-quobyte-d03e8acb-c8d7-489a-98ae-23fe200a9545" released by "delete_volume" :: held 2.155s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:56:18 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Created reservations ['42d2f296-2300-464c-8b10-2b12d9ceac06', '15f24d1f-45bf-45c0-b125-2385f17dc8c3', '6b06c06b-6bd0-4405-b534-695b4adbad49', '5da568ae-1df4-4854-8396-096ed8f8d9eb'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:56:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:56:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:56:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:18 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:56:18 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:19 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.638s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:19 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:56:19 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Deleted volume successfully. Jul 08 02:56:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8d2812df-ba84-40bb-b7ae-1dd53946e7ff tempest-VolumeImageDependencyTests-1300869532 None] Lock "cinder-d03e8acb-c8d7-489a-98ae-23fe200a9545-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Flow 'volume_create_manager' (a36733e4-039a-4f9a-813f-5fcfdb20061e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9136addb-829f-40af-85ea-dcefcd41f1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9136addb-829f-40af-85ea-dcefcd41f1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f677c1b-a34e-4781-a5c0-7b79338598fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6c713cdb4b49aa927aeeb4fa09ed3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:56:22Z,use_quota=True,user_id='ef043390a5044d5d9a9ed3490ee42309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c7bb6b-58b5-471e-91d7-ba50d82285de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c7bb6b-58b5-471e-91d7-ba50d82285de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47498b8c-273f-46e9-a49a-0570400ea5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47498b8c-273f-46e9-a49a-0570400ea5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f677c1b-a34e-4781-a5c0-7b79338598fb', 'volume_name': 'volume-3f677c1b-a34e-4781-a5c0-7b79338598fb', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05c01a0-347d-4826-8b1c-80b5fb724df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05c01a0-347d-4826-8b1c-80b5fb724df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73754934-617d-4010-9c72-5d9e4a1f2e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:22 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Volume 3f677c1b-a34e-4781-a5c0-7b79338598fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f677c1b-a34e-4781-a5c0-7b79338598fb', 'volume_size': 1} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f677c1b-a34e-4781-a5c0-7b79338598fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6c713cdb4b49aa927aeeb4fa09ed3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:56:22Z,use_quota=True,user_id='ef043390a5044d5d9a9ed3490ee42309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Creating volume 3f677c1b-a34e-4781-a5c0-7b79338598fb {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:56:22 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:56:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3f677c1b-a34e-4781-a5c0-7b79338598fb 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:22 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3f677c1b-a34e-4781-a5c0-7b79338598fb 1073741824 Jul 08 02:56:22 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:23 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3f677c1b-a34e-4781-a5c0-7b79338598fb 1073741824" returned: 0 in 0.802s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3f677c1b-a34e-4781-a5c0-7b79338598fb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:23 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3f677c1b-a34e-4781-a5c0-7b79338598fb Jul 08 02:56:23 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:24 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3f677c1b-a34e-4781-a5c0-7b79338598fb" returned: 0 in 0.640s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:56:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73754934-617d-4010-9c72-5d9e4a1f2e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f677c1b-a34e-4781-a5c0-7b79338598fb', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4f1d5d-2661-4425-bb7b-a02f2bad9b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:24 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Volume volume-3f677c1b-a34e-4781-a5c0-7b79338598fb (3f677c1b-a34e-4781-a5c0-7b79338598fb): created successfully Jul 08 02:56:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4f1d5d-2661-4425-bb7b-a02f2bad9b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Flow 'volume_create_manager' (a36733e4-039a-4f9a-813f-5fcfdb20061e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:56:24 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-83576559-ca5f-41fe-9ba1-bcec63fdeea9 tempest-CinderUnicodeTest-151279549 None] Created volume successfully. Jul 08 02:56:24 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Flow 'volume_create_manager' (45231354-4bdb-4a4c-92db-f807723521f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1811e0b3-e1ea-4e74-85b6-03fbda9ff481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1811e0b3-e1ea-4e74-85b6-03fbda9ff481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:56:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2059103556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1534849-55f8-4960-bdd5-4d451154ca0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6c713cdb4b49aa927aeeb4fa09ed3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:56:25Z,use_quota=True,user_id='ef043390a5044d5d9a9ed3490ee42309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a129ab44-6ae4-4944-b693-0102088dc323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a129ab44-6ae4-4944-b693-0102088dc323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441ec252-5c18-41a1-bec6-e98ace48f282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441ec252-5c18-41a1-bec6-e98ace48f282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1534849-55f8-4960-bdd5-4d451154ca0c', 'volume_name': 'volume-b1534849-55f8-4960-bdd5-4d451154ca0c', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e743a3cc-c095-4d85-92de-1096ead4f86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e743a3cc-c095-4d85-92de-1096ead4f86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6a58dd-7e6c-4859-a1f8-0b830bf4c12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:25 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Volume b1534849-55f8-4960-bdd5-4d451154ca0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1534849-55f8-4960-bdd5-4d451154ca0c', 'volume_size': 1} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:56:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2059103556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1534849-55f8-4960-bdd5-4d451154ca0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6c713cdb4b49aa927aeeb4fa09ed3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:56:25Z,use_quota=True,user_id='ef043390a5044d5d9a9ed3490ee42309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Creating volume b1534849-55f8-4960-bdd5-4d451154ca0c {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:56:25 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:25 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c 1073741824 Jul 08 02:56:25 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:25 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c 1073741824" returned: 0 in 0.810s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:25 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c Jul 08 02:56:25 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:26 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c" returned: 0 in 0.634s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:56:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:26 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6a58dd-7e6c-4859-a1f8-0b830bf4c12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1534849-55f8-4960-bdd5-4d451154ca0c', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:26 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc773af0-cf3d-4f9e-8a21-d47e0a876853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:26 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Volume volume-b1534849-55f8-4960-bdd5-4d451154ca0c (b1534849-55f8-4960-bdd5-4d451154ca0c): created successfully Jul 08 02:56:26 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc773af0-cf3d-4f9e-8a21-d47e0a876853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:26 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Flow 'volume_create_manager' (45231354-4bdb-4a4c-92db-f807723521f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:56:26 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c477f097-c7ca-46f5-ac15-5b96b305d40b tempest-CinderUnicodeTest-151279549 None] Created volume successfully. Jul 08 02:56:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] Creating offline snapshot 0fa0f796-a897-40ba-b495-1150534fded7 of volume b1534849-55f8-4960-bdd5-4d451154ca0c {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:56:27 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a150c814-0fc6-4926-8fea-ad9e366c1825]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:56:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:27 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c Jul 08 02:56:27 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:28 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c" returned: 0 in 0.743s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:28 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7 1G Jul 08 02:56:28 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:28 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7 1G" returned: 0 in 0.774s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1534849-55f8-4960-bdd5-4d451154ca0c -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:28 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1534849-55f8-4960-bdd5-4d451154ca0c -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7 Jul 08 02:56:28 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:29 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1534849-55f8-4960-bdd5-4d451154ca0c -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7" returned: 0 in 0.674s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:29 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7 is being set with open permissions: ugo+rw Jul 08 02:56:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:29 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7 Jul 08 02:56:29 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:30 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7" returned: 0 in 0.636s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:30 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.info Jul 08 02:56:30 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:30 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.info" returned: 0 in 0.624s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:30 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.info is being set with open permissions: ugo+rw Jul 08 02:56:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:30 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.info Jul 08 02:56:30 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:31 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.info" returned: 0 in 0.635s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.170s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:31 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0bb1bfef-ace1-4714-98f3-70d3852f567c tempest-CinderUnicodeTest-151279549 None] Create snapshot completed successfully Jul 08 02:56:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Acquiring lock "cinder-0fa0f796-a897-40ba-b495-1150534fded7-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Lock "cinder-0fa0f796-a897-40ba-b495-1150534fded7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Acquiring lock "cinder-quobyte-b1534849-55f8-4960-bdd5-4d451154ca0c" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Lock "cinder-quobyte-b1534849-55f8-4960-bdd5-4d451154ca0c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Acquiring lock "cinder-quobyte-0fa0f796-a897-40ba-b495-1150534fded7" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Lock "cinder-quobyte-0fa0f796-a897-40ba-b495-1150534fded7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Deleting offline snapshot 0fa0f796-a897-40ba-b495-1150534fded7 of volume b1534849-55f8-4960-bdd5-4d451154ca0c {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:56:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] snapshot_file for this snap is: volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:56:32 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01505d5-5606-4b24-9d40-0419fb91ef07]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:56:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:32 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7 Jul 08 02:56:32 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:33 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7" returned: 0 in 0.743s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1534849-55f8-4960-bdd5-4d451154ca0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:56:33 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[8586b17f-994b-42ea-bdc9-4a636d3d3e01]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:56:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:33 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c Jul 08 02:56:33 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:34 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c" returned: 0 in 0.737s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:34 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7 Jul 08 02:56:34 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:34 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7" returned: 0 in 0.715s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:34 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7 Jul 08 02:56:34 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:35 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c.0fa0f796-a897-40ba-b495-1150534fded7" returned: 0 in 0.625s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Lock "cinder-quobyte-0fa0f796-a897-40ba-b495-1150534fded7" released by "_delete_snapshot" :: held 2.921s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:56:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Lock "cinder-quobyte-b1534849-55f8-4960-bdd5-4d451154ca0c" released by "delete_snapshot" :: held 2.950s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:56:35 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Created reservations ['e729bdd8-79d0-43e8-9f55-b2887386b82b', '93c16288-c0a2-4670-b494-344605255c8e', '9af60a98-5855-4873-8f8d-3faf9a8caefa', '7c8bd714-1027-4de5-9384-990326616862'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:56:35 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Delete snapshot completed successfully. Jul 08 02:56:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-9fccd2a2-92ab-46ab-a4f5-5a82ce80bbc3 tempest-CinderUnicodeTest-151279549 None] Lock "cinder-0fa0f796-a897-40ba-b495-1150534fded7-delete_snapshot" released by "delete_snapshot" :: held 3.068s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:56:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Acquiring lock "cinder-b1534849-55f8-4960-bdd5-4d451154ca0c-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Lock "cinder-b1534849-55f8-4960-bdd5-4d451154ca0c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Acquiring lock "cinder-quobyte-b1534849-55f8-4960-bdd5-4d451154ca0c" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Lock "cinder-quobyte-b1534849-55f8-4960-bdd5-4d451154ca0c" acquired by "delete_volume" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:35 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca30d2f-f995-4746-bfc2-28d888ba5e8a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:56:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:35 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c Jul 08 02:56:35 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:36 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c" returned: 0 in 0.749s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:36 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c Jul 08 02:56:36 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:37 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b1534849-55f8-4960-bdd5-4d451154ca0c" returned: 0 in 0.638s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Lock "cinder-quobyte-b1534849-55f8-4960-bdd5-4d451154ca0c" released by "delete_volume" :: held 1.442s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:56:37 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Created reservations ['eeea00b6-488c-4d50-adf6-eb5538f8f72a', 'c8b9d4f3-f570-4961-af94-33d093e998ba', 'b1c5bd34-5e7c-4600-afbe-545cfdde01c1', 'f0bfc0a4-1f7b-4db4-9b02-13380c277f56'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:56:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:56:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:56:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:37 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:56:37 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Acquiring lock "cinder-3f677c1b-a34e-4781-a5c0-7b79338598fb-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Lock "cinder-3f677c1b-a34e-4781-a5c0-7b79338598fb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:37 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.676s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:37 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:56:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Acquiring lock "cinder-quobyte-3f677c1b-a34e-4781-a5c0-7b79338598fb" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:37 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Deleted volume successfully. Jul 08 02:56:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Lock "cinder-quobyte-3f677c1b-a34e-4781-a5c0-7b79338598fb" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-de3a770e-ad2b-42a3-a5bd-d86d8421d0f4 tempest-CinderUnicodeTest-151279549 None] Lock "cinder-b1534849-55f8-4960-bdd5-4d451154ca0c-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:56:38 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[76441c20-52d0-4d36-869d-a4f86a4d2525]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:56:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3f677c1b-a34e-4781-a5c0-7b79338598fb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:38 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3f677c1b-a34e-4781-a5c0-7b79338598fb Jul 08 02:56:38 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:38 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3f677c1b-a34e-4781-a5c0-7b79338598fb" returned: 0 in 0.741s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3f677c1b-a34e-4781-a5c0-7b79338598fb {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:38 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3f677c1b-a34e-4781-a5c0-7b79338598fb Jul 08 02:56:38 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:39 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3f677c1b-a34e-4781-a5c0-7b79338598fb" returned: 0 in 0.644s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Lock "cinder-quobyte-3f677c1b-a34e-4781-a5c0-7b79338598fb" released by "delete_volume" :: held 1.428s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:56:39 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Created reservations ['d8ea2d39-cdf2-42fd-8eac-3b10f7157e40', '246ff6ed-508f-4c37-97ad-3728e866612b', 'fccca1e4-8d54-487e-b894-119e5bcc099d', '2484f7cd-6bbb-457f-9cf3-d132e2304b0b'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:56:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:56:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:56:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:39 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:56:39 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:40 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.636s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:40 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:56:40 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Deleted volume successfully. Jul 08 02:56:40 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=46,cinder:INSERT=18,cinder:UPDATE=57,cinder:DELETE=5 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:56:40 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dc34c980-741e-4e79-bd5c-a8323423e241 tempest-CinderUnicodeTest-151279549 None] Lock "cinder-3f677c1b-a34e-4781-a5c0-7b79338598fb-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=52,cinder:SELECT=53,cinder:INSERT=26,cinder:DELETE=4 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Flow 'volume_create_manager' (f5182262-87fa-4fb4-b3f9-596f5659f9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c1acfb-06cf-4c8d-ae79-37d6044c60c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c1acfb-06cf-4c8d-ae79-37d6044c60c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2108102931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8dbd202-5f8f-49e0-89ed-76795861ef09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d86b9ec2f843edac790e524a3f05b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:56:43Z,use_quota=True,user_id='5221be720be34feca8186972ead85531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1baeb03c-9514-4ea9-912a-8f2be78e1aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1baeb03c-9514-4ea9-912a-8f2be78e1aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb85e66c-3426-433f-a071-42e66f07fb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb85e66c-3426-433f-a071-42e66f07fb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8dbd202-5f8f-49e0-89ed-76795861ef09', 'volume_name': 'volume-c8dbd202-5f8f-49e0-89ed-76795861ef09', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0abd20-f741-4fa1-bcbe-a53f40044eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0abd20-f741-4fa1-bcbe-a53f40044eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e609796-67ca-4586-8a27-c472f31416ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:43 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Volume c8dbd202-5f8f-49e0-89ed-76795861ef09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8dbd202-5f8f-49e0-89ed-76795861ef09', 'volume_size': 1} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2108102931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8dbd202-5f8f-49e0-89ed-76795861ef09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d86b9ec2f843edac790e524a3f05b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:56:43Z,use_quota=True,user_id='5221be720be34feca8186972ead85531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Creating volume c8dbd202-5f8f-49e0-89ed-76795861ef09 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:56:43 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:56:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8dbd202-5f8f-49e0-89ed-76795861ef09 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:43 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8dbd202-5f8f-49e0-89ed-76795861ef09 1073741824 Jul 08 02:56:43 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:44 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8dbd202-5f8f-49e0-89ed-76795861ef09 1073741824" returned: 0 in 0.807s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8dbd202-5f8f-49e0-89ed-76795861ef09 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:44 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8dbd202-5f8f-49e0-89ed-76795861ef09 Jul 08 02:56:44 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:44 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8dbd202-5f8f-49e0-89ed-76795861ef09" returned: 0 in 0.630s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:44 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:56:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e609796-67ca-4586-8a27-c472f31416ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8dbd202-5f8f-49e0-89ed-76795861ef09', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909ebe39-eb07-4a77-bbfe-d039fca14a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:44 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Volume volume-c8dbd202-5f8f-49e0-89ed-76795861ef09 (c8dbd202-5f8f-49e0-89ed-76795861ef09): created successfully Jul 08 02:56:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909ebe39-eb07-4a77-bbfe-d039fca14a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:44 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Flow 'volume_create_manager' (f5182262-87fa-4fb4-b3f9-596f5659f9c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:56:44 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-91c4e6c8-a6eb-49f4-9fef-225691a68449 tempest-ProjectReaderTests-563036874 None] Created volume successfully. Jul 08 02:56:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Acquiring lock "cinder-c8dbd202-5f8f-49e0-89ed-76795861ef09-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Lock "cinder-c8dbd202-5f8f-49e0-89ed-76795861ef09-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Acquiring lock "cinder-quobyte-c8dbd202-5f8f-49e0-89ed-76795861ef09" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Lock "cinder-quobyte-c8dbd202-5f8f-49e0-89ed-76795861ef09" acquired by "delete_volume" :: waited 0.013s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:45 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[6315c6e0-e30c-4e32-815e-90880ce87811]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:56:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8dbd202-5f8f-49e0-89ed-76795861ef09 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:45 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8dbd202-5f8f-49e0-89ed-76795861ef09 Jul 08 02:56:45 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:46 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8dbd202-5f8f-49e0-89ed-76795861ef09" returned: 0 in 0.745s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8dbd202-5f8f-49e0-89ed-76795861ef09 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:46 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8dbd202-5f8f-49e0-89ed-76795861ef09 Jul 08 02:56:46 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:46 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c8dbd202-5f8f-49e0-89ed-76795861ef09" returned: 0 in 0.632s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Lock "cinder-quobyte-c8dbd202-5f8f-49e0-89ed-76795861ef09" released by "delete_volume" :: held 1.417s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:56:46 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Created reservations ['602e1850-fa19-46cd-8f51-af04718abb94', '1a1e75eb-8ccc-4bbb-ac35-c55846aa9328', 'e32d8eb0-22e6-4b48-b298-ce571f4e1875', 'b221f613-f6b5-4644-b266-b3daf0ddaae6'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:47 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:56:47 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:47 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:56:47 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:47 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.651s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:56:47 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Deleted volume successfully. Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b3c25ada-58b3-41a0-939d-e719ba5b94ea tempest-ProjectReaderTests-563036874 None] Lock "cinder-c8dbd202-5f8f-49e0-89ed-76795861ef09-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:56:47 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.664s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:56:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Flow 'volume_create_manager' (2245679c-2904-4af8-b3d4-8e771fce318b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec31425-572a-4db2-b576-4a94deaa4a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec31425-572a-4db2-b576-4a94deaa4a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1389286341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0801386-f958-46b6-b349-ef9277e9b185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d86b9ec2f843edac790e524a3f05b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:56:48Z,use_quota=True,user_id='5221be720be34feca8186972ead85531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00101622-2ce9-4081-8ded-428f971fc77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00101622-2ce9-4081-8ded-428f971fc77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e939918-a344-4a3e-b005-f0370f0d49b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e939918-a344-4a3e-b005-f0370f0d49b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0801386-f958-46b6-b349-ef9277e9b185', 'volume_name': 'volume-e0801386-f958-46b6-b349-ef9277e9b185', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (222bb558-3466-4303-bfe7-2dd5e9fc620c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (222bb558-3466-4303-bfe7-2dd5e9fc620c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f448365-f78b-4a27-a8fc-f28064067c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:48 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Volume e0801386-f958-46b6-b349-ef9277e9b185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0801386-f958-46b6-b349-ef9277e9b185', 'volume_size': 1} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1389286341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0801386-f958-46b6-b349-ef9277e9b185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d86b9ec2f843edac790e524a3f05b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:56:48Z,use_quota=True,user_id='5221be720be34feca8186972ead85531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Creating volume e0801386-f958-46b6-b349-ef9277e9b185 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:56:48 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e0801386-f958-46b6-b349-ef9277e9b185 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:48 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e0801386-f958-46b6-b349-ef9277e9b185 1073741824 Jul 08 02:56:48 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:48 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e0801386-f958-46b6-b349-ef9277e9b185 1073741824" returned: 0 in 0.779s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e0801386-f958-46b6-b349-ef9277e9b185 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:49 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e0801386-f958-46b6-b349-ef9277e9b185 Jul 08 02:56:49 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:49 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e0801386-f958-46b6-b349-ef9277e9b185" returned: 0 in 0.634s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:56:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f448365-f78b-4a27-a8fc-f28064067c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0801386-f958-46b6-b349-ef9277e9b185', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a988ae8-d24f-4e0c-9474-10a4ad65c101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:49 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Volume volume-e0801386-f958-46b6-b349-ef9277e9b185 (e0801386-f958-46b6-b349-ef9277e9b185): created successfully Jul 08 02:56:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a988ae8-d24f-4e0c-9474-10a4ad65c101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Flow 'volume_create_manager' (2245679c-2904-4af8-b3d4-8e771fce318b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:56:49 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-4a4df689-cbfc-4d2c-8978-174fa2406b84 tempest-ProjectReaderTests-563036874 None] Created volume successfully. Jul 08 02:56:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Acquiring lock "cinder-e0801386-f958-46b6-b349-ef9277e9b185-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Lock "cinder-e0801386-f958-46b6-b349-ef9277e9b185-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Acquiring lock "cinder-quobyte-e0801386-f958-46b6-b349-ef9277e9b185" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Lock "cinder-quobyte-e0801386-f958-46b6-b349-ef9277e9b185" acquired by "delete_volume" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:50 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a861ec8-ffce-4055-8c7c-ce4fb81650e2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:56:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e0801386-f958-46b6-b349-ef9277e9b185 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:50 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e0801386-f958-46b6-b349-ef9277e9b185 Jul 08 02:56:50 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:51 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e0801386-f958-46b6-b349-ef9277e9b185" returned: 0 in 0.738s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e0801386-f958-46b6-b349-ef9277e9b185 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:51 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e0801386-f958-46b6-b349-ef9277e9b185 Jul 08 02:56:51 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:51 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e0801386-f958-46b6-b349-ef9277e9b185" returned: 0 in 0.624s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Lock "cinder-quobyte-e0801386-f958-46b6-b349-ef9277e9b185" released by "delete_volume" :: held 1.397s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:56:51 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Created reservations ['a948739c-8063-4bd8-9503-49270a90abff', 'f8ac8a3b-5c82-4e26-87bf-a3ecbe80981a', 'f4df6dae-c45d-44dc-a610-1fbc17776ecb', '3dced052-4b0e-44a5-ba7b-62b2109492fc'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:56:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:56:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:56:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:51 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:56:51 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:52 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.639s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:56:52 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Deleted volume successfully. Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-fad4d4d9-c845-4026-9bb3-4b5740480565 tempest-ProjectReaderTests-563036874 None] Lock "cinder-e0801386-f958-46b6-b349-ef9277e9b185-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Flow 'volume_create_manager' (b8e47942-a7f2-42bd-92d1-70fcac1a8d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8353413f-88a9-4d49-93a3-0fe0890b52dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8353413f-88a9-4d49-93a3-0fe0890b52dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1833017069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16cc74b6-3d8d-4c8e-91d1-5e0978675f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d86b9ec2f843edac790e524a3f05b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:56:53Z,use_quota=True,user_id='5221be720be34feca8186972ead85531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab1adcf-658e-48ef-9ec5-1a728bf7c522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab1adcf-658e-48ef-9ec5-1a728bf7c522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fed95ee-509c-49b1-ac80-0ee47a00164d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fed95ee-509c-49b1-ac80-0ee47a00164d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16cc74b6-3d8d-4c8e-91d1-5e0978675f46', 'volume_name': 'volume-16cc74b6-3d8d-4c8e-91d1-5e0978675f46', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c16014-9884-4e5a-ada3-49e03d6142bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c16014-9884-4e5a-ada3-49e03d6142bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902dc6ee-44c9-4b40-a26c-d9ded6281489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:52 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Volume 16cc74b6-3d8d-4c8e-91d1-5e0978675f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16cc74b6-3d8d-4c8e-91d1-5e0978675f46', 'volume_size': 1} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1833017069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16cc74b6-3d8d-4c8e-91d1-5e0978675f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d86b9ec2f843edac790e524a3f05b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:56:53Z,use_quota=True,user_id='5221be720be34feca8186972ead85531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Creating volume 16cc74b6-3d8d-4c8e-91d1-5e0978675f46 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:56:52 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:56:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-16cc74b6-3d8d-4c8e-91d1-5e0978675f46 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:53 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-16cc74b6-3d8d-4c8e-91d1-5e0978675f46 1073741824 Jul 08 02:56:53 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:53 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-16cc74b6-3d8d-4c8e-91d1-5e0978675f46 1073741824" returned: 0 in 0.839s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-16cc74b6-3d8d-4c8e-91d1-5e0978675f46 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:53 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-16cc74b6-3d8d-4c8e-91d1-5e0978675f46 Jul 08 02:56:53 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:54 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-16cc74b6-3d8d-4c8e-91d1-5e0978675f46" returned: 0 in 0.659s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:54 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:56:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902dc6ee-44c9-4b40-a26c-d9ded6281489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16cc74b6-3d8d-4c8e-91d1-5e0978675f46', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff41a459-d52d-4db2-9c03-c4e13a9ecc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:54 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Volume volume-16cc74b6-3d8d-4c8e-91d1-5e0978675f46 (16cc74b6-3d8d-4c8e-91d1-5e0978675f46): created successfully Jul 08 02:56:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff41a459-d52d-4db2-9c03-c4e13a9ecc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Flow 'volume_create_manager' (b8e47942-a7f2-42bd-92d1-70fcac1a8d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:56:54 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-025a36ce-8d22-4ada-a382-caecbc927c76 tempest-ProjectReaderTests-563036874 None] Created volume successfully. Jul 08 02:56:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Acquiring lock "cinder-16cc74b6-3d8d-4c8e-91d1-5e0978675f46-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Lock "cinder-16cc74b6-3d8d-4c8e-91d1-5e0978675f46-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Acquiring lock "cinder-quobyte-16cc74b6-3d8d-4c8e-91d1-5e0978675f46" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Lock "cinder-quobyte-16cc74b6-3d8d-4c8e-91d1-5e0978675f46" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:55 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[77992584-24dd-45da-9e9d-9cb47cb57374]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:56:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-16cc74b6-3d8d-4c8e-91d1-5e0978675f46 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:55 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-16cc74b6-3d8d-4c8e-91d1-5e0978675f46 Jul 08 02:56:55 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:55 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-16cc74b6-3d8d-4c8e-91d1-5e0978675f46" returned: 0 in 0.743s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-16cc74b6-3d8d-4c8e-91d1-5e0978675f46 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:55 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-16cc74b6-3d8d-4c8e-91d1-5e0978675f46 Jul 08 02:56:55 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:56 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-16cc74b6-3d8d-4c8e-91d1-5e0978675f46" returned: 0 in 0.634s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Lock "cinder-quobyte-16cc74b6-3d8d-4c8e-91d1-5e0978675f46" released by "delete_volume" :: held 1.415s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:56:56 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Created reservations ['7a10a890-7bda-473c-ba36-955c059615a8', 'c92cc11d-e732-4827-838e-9366c3e4d9a6', 'c136c74f-28fc-4061-af94-85960ad698e9', '64be8603-648b-4360-b0d2-f8db7b5bbf68'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:56:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:56:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:56:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:56 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:56:56 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:57 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.648s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:56:57 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Deleted volume successfully. Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-19bbb0ae-5be2-477f-b8cc-25c5fa8224d7 tempest-ProjectReaderTests-563036874 None] Lock "cinder-16cc74b6-3d8d-4c8e-91d1-5e0978675f46-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Flow 'volume_create_manager' (cc181635-03c5-4e8c-9d47-7144f03683c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d166d6ac-69c9-488b-9968-eccccd7f20bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d166d6ac-69c9-488b-9968-eccccd7f20bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-319603463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5dc35c-d7d0-462d-9c55-ca214ca13a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d86b9ec2f843edac790e524a3f05b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:56:58Z,use_quota=True,user_id='5221be720be34feca8186972ead85531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a5c948-1bb7-47de-8244-932e2de29fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a5c948-1bb7-47de-8244-932e2de29fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231ff540-1a4c-4ff0-9527-9b4a28b9ef2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231ff540-1a4c-4ff0-9527-9b4a28b9ef2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa5dc35c-d7d0-462d-9c55-ca214ca13a91', 'volume_name': 'volume-fa5dc35c-d7d0-462d-9c55-ca214ca13a91', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1340d074-5bd2-4a1a-bc2a-58919f8edb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1340d074-5bd2-4a1a-bc2a-58919f8edb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb22ef9-5054-457c-9e4c-2a1f4b1e2195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:57 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Volume fa5dc35c-d7d0-462d-9c55-ca214ca13a91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa5dc35c-d7d0-462d-9c55-ca214ca13a91', 'volume_size': 1} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-319603463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5dc35c-d7d0-462d-9c55-ca214ca13a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d86b9ec2f843edac790e524a3f05b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:56:58Z,use_quota=True,user_id='5221be720be34feca8186972ead85531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Creating volume fa5dc35c-d7d0-462d-9c55-ca214ca13a91 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:56:57 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:56:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa5dc35c-d7d0-462d-9c55-ca214ca13a91 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:57 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa5dc35c-d7d0-462d-9c55-ca214ca13a91 1073741824 Jul 08 02:56:57 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:58 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa5dc35c-d7d0-462d-9c55-ca214ca13a91 1073741824" returned: 0 in 0.824s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa5dc35c-d7d0-462d-9c55-ca214ca13a91 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:58 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa5dc35c-d7d0-462d-9c55-ca214ca13a91 Jul 08 02:56:58 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:56:59 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 08 02:56:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa5dc35c-d7d0-462d-9c55-ca214ca13a91" returned: 0 in 0.644s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:56:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:56:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:56:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb22ef9-5054-457c-9e4c-2a1f4b1e2195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5dc35c-d7d0-462d-9c55-ca214ca13a91', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab3da3a-9ab8-40f4-be53-c9155399d1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:56:59 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Volume volume-fa5dc35c-d7d0-462d-9c55-ca214ca13a91 (fa5dc35c-d7d0-462d-9c55-ca214ca13a91): created successfully Jul 08 02:56:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab3da3a-9ab8-40f4-be53-c9155399d1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:56:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Flow 'volume_create_manager' (cc181635-03c5-4e8c-9d47-7144f03683c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:56:59 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c996413d-aaad-4acb-9947-00228f382388 tempest-ProjectReaderTests-563036874 None] Created volume successfully. Jul 08 02:56:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Acquiring lock "cinder-fa5dc35c-d7d0-462d-9c55-ca214ca13a91-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Lock "cinder-fa5dc35c-d7d0-462d-9c55-ca214ca13a91-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Acquiring lock "cinder-quobyte-fa5dc35c-d7d0-462d-9c55-ca214ca13a91" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:56:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Lock "cinder-quobyte-fa5dc35c-d7d0-462d-9c55-ca214ca13a91" acquired by "delete_volume" :: waited 0.013s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:56:59 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3983112-b363-484b-95f5-cd5799b0f5aa]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:56:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa5dc35c-d7d0-462d-9c55-ca214ca13a91 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:56:59 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa5dc35c-d7d0-462d-9c55-ca214ca13a91 Jul 08 02:56:59 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:00 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa5dc35c-d7d0-462d-9c55-ca214ca13a91" returned: 0 in 0.743s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa5dc35c-d7d0-462d-9c55-ca214ca13a91 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:00 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa5dc35c-d7d0-462d-9c55-ca214ca13a91 Jul 08 02:57:00 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:01 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fa5dc35c-d7d0-462d-9c55-ca214ca13a91" returned: 0 in 0.661s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:01 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Lock "cinder-quobyte-fa5dc35c-d7d0-462d-9c55-ca214ca13a91" released by "delete_volume" :: held 1.442s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:01 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Created reservations ['dcec0573-c5af-4c1c-8058-61d00fe17b35', '6feba75e-1bd7-4a68-b492-208a181e724c', 'e6f0d296-8832-45a5-9507-c0763e13adfc', 'a8ff5468-a097-4fcf-9e8b-91de33ac40c9'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:57:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:01 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:57:01 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:02 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.671s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:02 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:57:02 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Deleted volume successfully. Jul 08 02:57:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-9609d182-5bf8-4d49-83ff-f429f1d7caeb tempest-ProjectReaderTests-563036874 None] Lock "cinder-fa5dc35c-d7d0-462d-9c55-ca214ca13a91-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:11 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=48,cinder:SELECT=30,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:57:12 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=25,cinder:UPDATE=40,cinder:INSERT=10,cinder:DELETE=6 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Flow 'volume_create_manager' (457a174d-d20f-4b75-bc31-d281843f65f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6636ab42-d7c2-42ee-ad5a-1da983a42499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6636ab42-d7c2-42ee-ad5a-1da983a42499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-180051346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5d9ff8-c50d-4dec-8c6b-142f0009093a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e0c6c8f8b64152a801a9507038906d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:14Z,use_quota=True,user_id='7eb1d8942a0a43dd8dc2e7938a172a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00dcd4eb-2737-450c-aa52-a4a3fc820994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00dcd4eb-2737-450c-aa52-a4a3fc820994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af3f16e-f8f7-4c8c-899d-a6e92278be0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af3f16e-f8f7-4c8c-899d-a6e92278be0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb5d9ff8-c50d-4dec-8c6b-142f0009093a', 'volume_name': 'volume-eb5d9ff8-c50d-4dec-8c6b-142f0009093a', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f331fa2f-b0d1-4b8c-9fc8-0dadd6acf5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f331fa2f-b0d1-4b8c-9fc8-0dadd6acf5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a9a5fc-d3f2-4be1-8002-19fe970e6f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:14 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Volume eb5d9ff8-c50d-4dec-8c6b-142f0009093a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb5d9ff8-c50d-4dec-8c6b-142f0009093a', 'volume_size': 1} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-180051346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5d9ff8-c50d-4dec-8c6b-142f0009093a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e0c6c8f8b64152a801a9507038906d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:14Z,use_quota=True,user_id='7eb1d8942a0a43dd8dc2e7938a172a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Creating volume eb5d9ff8-c50d-4dec-8c6b-142f0009093a {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:57:14 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eb5d9ff8-c50d-4dec-8c6b-142f0009093a 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:14 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eb5d9ff8-c50d-4dec-8c6b-142f0009093a 1073741824 Jul 08 02:57:14 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Flow 'volume_create_manager' (e5a96b40-4569-4b16-8739-33524cd9695c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737e63bc-1ced-4496-93ee-76b8dfb1113a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737e63bc-1ced-4496-93ee-76b8dfb1113a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-74944308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8da5f4e-92a2-4a09-9ba6-c5a5196c7840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1a956194e841f5977dc3591f7de37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:14Z,use_quota=True,user_id='a11340f3614a46cdb12be2a8353f9844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c581fee7-4862-472d-b28d-447fb696daec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c581fee7-4862-472d-b28d-447fb696daec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552ce4d7-aa60-4bd7-9bc8-f14ca6e41e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552ce4d7-aa60-4bd7-9bc8-f14ca6e41e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8da5f4e-92a2-4a09-9ba6-c5a5196c7840', 'volume_name': 'volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbdfe28-40d4-4b8b-b467-a6f1fe907ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbdfe28-40d4-4b8b-b467-a6f1fe907ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c7c936-1fe6-48cd-bf79-c6473b112e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:14 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume b8da5f4e-92a2-4a09-9ba6-c5a5196c7840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840', 'volume_size': 1} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Flow 'volume_create_manager' (973eafb7-26bf-4ab3-8169-d8aef5f42fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594dcee6-f9dd-4b48-a08f-b447c353f0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594dcee6-f9dd-4b48-a08f-b447c353f0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1264941028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00806860-5c1d-48be-993d-d75d510195f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e0c6c8f8b64152a801a9507038906d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:15Z,use_quota=True,user_id='7eb1d8942a0a43dd8dc2e7938a172a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9ab802-47f0-4f6d-9dd6-59519af2bd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9ab802-47f0-4f6d-9dd6-59519af2bd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331f9a96-00ab-405b-9a7b-a5e4cad7a212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331f9a96-00ab-405b-9a7b-a5e4cad7a212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00806860-5c1d-48be-993d-d75d510195f5', 'volume_name': 'volume-00806860-5c1d-48be-993d-d75d510195f5', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b52e36-979e-4cb6-9e5f-1ac9a179094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b52e36-979e-4cb6-9e5f-1ac9a179094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287c0a47-ec6c-4c0e-b98e-9e82a17d8dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:14 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Volume 00806860-5c1d-48be-993d-d75d510195f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00806860-5c1d-48be-993d-d75d510195f5', 'volume_size': 1} Jul 08 02:57:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Flow 'volume_create_manager' (a02ceaa3-a91c-4eb3-bdd2-deadb58a70b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34657e8d-8147-458a-9034-85db8f56d17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34657e8d-8147-458a-9034-85db8f56d17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-207643068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea2d54f-a416-413b-b144-5b5cb3824f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e0c6c8f8b64152a801a9507038906d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:15Z,use_quota=True,user_id='7eb1d8942a0a43dd8dc2e7938a172a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7932b8ae-3389-49e6-9bda-ede13947822c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7932b8ae-3389-49e6-9bda-ede13947822c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6871adff-7fd7-4e9b-8fcb-b5d0b7f2edc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6871adff-7fd7-4e9b-8fcb-b5d0b7f2edc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea2d54f-a416-413b-b144-5b5cb3824f7a', 'volume_name': 'volume-dea2d54f-a416-413b-b144-5b5cb3824f7a', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0ad1c7-8b93-488a-817e-ca262618776c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0ad1c7-8b93-488a-817e-ca262618776c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccddaec0-729c-40ec-b162-8c357a6d11d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:15 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Volume dea2d54f-a416-413b-b144-5b5cb3824f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea2d54f-a416-413b-b144-5b5cb3824f7a', 'volume_size': 1} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:15 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eb5d9ff8-c50d-4dec-8c6b-142f0009093a 1073741824" returned: 0 in 1.115s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eb5d9ff8-c50d-4dec-8c6b-142f0009093a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:15 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eb5d9ff8-c50d-4dec-8c6b-142f0009093a Jul 08 02:57:15 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Flow 'volume_create_manager' (41e2917f-6e09-4195-bb34-ee5363596b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd95d082-b2b9-4e86-badf-3cf6c36c8de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd95d082-b2b9-4e86-badf-3cf6c36c8de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-286957451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98c1439b30f40659ec191e26a8cf57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:15Z,use_quota=True,user_id='90715228d23e42dd81715344bc0d64e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66739e4-048c-467e-8cfe-58fb7fe252cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66739e4-048c-467e-8cfe-58fb7fe252cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9de8f6-2727-4ba7-92a5-7deb573db580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9de8f6-2727-4ba7-92a5-7deb573db580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3', 'volume_name': 'volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e75597c-8da0-4a5d-b09c-3bf238b73128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e75597c-8da0-4a5d-b09c-3bf238b73128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd42e306-0314-4bd9-a476-05c575225f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:15 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Volume 2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3', 'volume_size': 1} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Flow 'volume_create_manager' (99601761-aa84-4dbe-897c-510296c46971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72577682-5193-4d52-801a-190d2a9b80fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72577682-5193-4d52-801a-190d2a9b80fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-957698013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa2fe92-c214-43ce-9ef8-fc263124e882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e0c6c8f8b64152a801a9507038906d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:16Z,use_quota=True,user_id='7eb1d8942a0a43dd8dc2e7938a172a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaaa713-efcc-4aa3-856b-c2902e6ebe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaaa713-efcc-4aa3-856b-c2902e6ebe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc769cc3-9592-4d4b-bf1d-8b95ab2cbb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc769cc3-9592-4d4b-bf1d-8b95ab2cbb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aa2fe92-c214-43ce-9ef8-fc263124e882', 'volume_name': 'volume-6aa2fe92-c214-43ce-9ef8-fc263124e882', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7bfe3a-6ec5-47fb-beef-7aeb69e5b8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7bfe3a-6ec5-47fb-beef-7aeb69e5b8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170fcf93-30b3-4e67-ad50-a4cc74d3caca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:15 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Volume 6aa2fe92-c214-43ce-9ef8-fc263124e882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aa2fe92-c214-43ce-9ef8-fc263124e882', 'volume_size': 1} Jul 08 02:57:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Flow 'volume_create_manager' (ba319dd8-6523-43aa-bdf6-6956e034903f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b711e94-5cd9-470e-9843-16da0a33dc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b711e94-5cd9-470e-9843-16da0a33dc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2036638728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d40fb733-6349-4231-b9a1-d3a39332e07e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e0c6c8f8b64152a801a9507038906d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:16Z,use_quota=True,user_id='7eb1d8942a0a43dd8dc2e7938a172a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efcd9eb6-aab2-449a-a0ce-18a1ddf5d2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efcd9eb6-aab2-449a-a0ce-18a1ddf5d2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9e0b5f-f5fc-41ed-be83-04b44f0fe4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9e0b5f-f5fc-41ed-be83-04b44f0fe4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd40fb733-6349-4231-b9a1-d3a39332e07e', 'volume_name': 'volume-d40fb733-6349-4231-b9a1-d3a39332e07e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b8a9e0-6c50-4db8-9fed-90995ffb13b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b8a9e0-6c50-4db8-9fed-90995ffb13b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8864c9d0-f597-45c4-a975-382a04d41c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:16 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Volume d40fb733-6349-4231-b9a1-d3a39332e07e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d40fb733-6349-4231-b9a1-d3a39332e07e', 'volume_size': 1} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:16 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eb5d9ff8-c50d-4dec-8c6b-142f0009093a" returned: 0 in 0.866s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.675s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-74944308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8da5f4e-92a2-4a09-9ba6-c5a5196c7840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1a956194e841f5977dc3591f7de37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:14Z,use_quota=True,user_id='a11340f3614a46cdb12be2a8353f9844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Creating volume b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:57:16 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:16 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 1073741824 Jul 08 02:57:16 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a9a5fc-d3f2-4be1-8002-19fe970e6f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5d9ff8-c50d-4dec-8c6b-142f0009093a', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdbd310-d24f-401b-8d1c-cee248aa9787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:16 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Volume volume-eb5d9ff8-c50d-4dec-8c6b-142f0009093a (eb5d9ff8-c50d-4dec-8c6b-142f0009093a): created successfully Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdbd310-d24f-401b-8d1c-cee248aa9787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:16 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Flow 'volume_create_manager' (457a174d-d20f-4b75-bc31-d281843f65f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:16 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-449cc224-8b43-4180-8b81-6948c7c3803d tempest-CreateVolumesFromImageTest-1067060639 None] Created volume successfully. Jul 08 02:57:17 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 1073741824" returned: 0 in 0.928s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:17 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 Jul 08 02:57:17 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:17 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840" returned: 0 in 0.656s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.209s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1264941028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00806860-5c1d-48be-993d-d75d510195f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e0c6c8f8b64152a801a9507038906d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:15Z,use_quota=True,user_id='7eb1d8942a0a43dd8dc2e7938a172a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Creating volume 00806860-5c1d-48be-993d-d75d510195f5 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:57:17 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00806860-5c1d-48be-993d-d75d510195f5 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:17 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00806860-5c1d-48be-993d-d75d510195f5 1073741824 Jul 08 02:57:17 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c7c936-1fe6-48cd-bf79-c6473b112e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1e452e-021d-43bd-a1f0-63226489c95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:17 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 (b8da5f4e-92a2-4a09-9ba6-c5a5196c7840): created successfully Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1e452e-021d-43bd-a1f0-63226489c95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:17 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Flow 'volume_create_manager' (e5a96b40-4569-4b16-8739-33524cd9695c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:18 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e8edcec9-5e95-45a6-b24c-804bbcd242fd tempest-CreateVolumesFromSnapshotTest-2019968664 None] Created volume successfully. Jul 08 02:57:18 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Flow 'volume_create_manager' (14e7d700-f859-425a-9e26-7113e4fb1e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6abda0-cdcb-43a6-9703-cf677f7bf167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6abda0-cdcb-43a6-9703-cf677f7bf167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96b21d5-9d6f-4be1-9ebd-888ea9b40946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02d42573c454440b2cf11d368426098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:18Z,use_quota=True,user_id='56986b561ddd4df2a202967a0040d587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(222610e7-a792-4812-9aaa-815fc673d733),volume_type_id=222610e7-a792-4812-9aaa-815fc673d733)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a121c30d-6252-4b77-ac5f-4adc6aa212ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a121c30d-6252-4b77-ac5f-4adc6aa212ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe47ab4-b02d-4187-87d4-cb46d2d10474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:18 devstack cinder-volume[87238]: DEBUG cinder.image.glance [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Creating Keystone auth plugin from conf {{(pid=87238) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 02:57:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:18 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00806860-5c1d-48be-993d-d75d510195f5 1073741824" returned: 0 in 0.954s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe47ab4-b02d-4187-87d4-cb46d2d10474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f96b21d5-9d6f-4be1-9ebd-888ea9b40946', 'volume_name': 'volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946', 'volume_size': 1, 'image_id': 'c554e11c-cba0-4290-ac6e-444121f67a51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c554e11c-cba0-4290-ac6e-444121f67a51', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc71dd959d5a15b2ef3a8bab0c7cd882', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a02d42573c454440b2cf11d368426098', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a2a5a6399391de2213de3e839a74536245c4926c2de79c9ac2562e9cfd3eb9bb4ea126ba1216ad274191b0242fd97357bb6a7426c41866b621df68b7c921051', 'id': 'c554e11c-cba0-4290-ac6e-444121f67a51', 'created_at': datetime.datetime(2026, 7, 8, 0, 57, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c554e11c-cba0-4290-ac6e-444121f67a51/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (225a5ac7-1c02-472d-b607-810a8f8ce29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (225a5ac7-1c02-472d-b607-810a8f8ce29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50c1133-2dc8-4f68-aedb-aff3118b694b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:18 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Volume f96b21d5-9d6f-4be1-9ebd-888ea9b40946: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946', 'volume_size': 1, 'image_id': 'c554e11c-cba0-4290-ac6e-444121f67a51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c554e11c-cba0-4290-ac6e-444121f67a51', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc71dd959d5a15b2ef3a8bab0c7cd882', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a02d42573c454440b2cf11d368426098', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a2a5a6399391de2213de3e839a74536245c4926c2de79c9ac2562e9cfd3eb9bb4ea126ba1216ad274191b0242fd97357bb6a7426c41866b621df68b7c921051', 'id': 'c554e11c-cba0-4290-ac6e-444121f67a51', 'created_at': datetime.datetime(2026, 7, 8, 0, 57, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c554e11c-cba0-4290-ac6e-444121f67a51/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 02:57:18 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Trying to clone f96b21d5-9d6f-4be1-9ebd-888ea9b40946 from image c554e11c-cba0-4290-ac6e-444121f67a51 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c554e11c-cba0-4290-ac6e-444121f67a51', 'metadata': {}}]). {{(pid=87238) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 02:57:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00806860-5c1d-48be-993d-d75d510195f5 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:18 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00806860-5c1d-48be-993d-d75d510195f5 Jul 08 02:57:18 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 02:57:19 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Image download 0.00 MB at 0.00 MB/s Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79ca56f-3c02-4e6f-8653-bd21f0a55c4f]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:19 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD Jul 08 02:57:19 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:19 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00806860-5c1d-48be-993d-d75d510195f5" returned: 0 in 0.675s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.417s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-207643068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea2d54f-a416-413b-b144-5b5cb3824f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e0c6c8f8b64152a801a9507038906d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:15Z,use_quota=True,user_id='7eb1d8942a0a43dd8dc2e7938a172a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Creating volume dea2d54f-a416-413b-b144-5b5cb3824f7a {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:57:19 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dea2d54f-a416-413b-b144-5b5cb3824f7a 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:19 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dea2d54f-a416-413b-b144-5b5cb3824f7a 1073741824 Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287c0a47-ec6c-4c0e-b98e-9e82a17d8dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00806860-5c1d-48be-993d-d75d510195f5', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:19 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d2393c-fc75-43f4-b698-3ea60a2977f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:19 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Volume volume-00806860-5c1d-48be-993d-d75d510195f5 (00806860-5c1d-48be-993d-d75d510195f5): created successfully Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d2393c-fc75-43f4-b698-3ea60a2977f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Flow 'volume_create_manager' (973eafb7-26bf-4ab3-8169-d8aef5f42fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:19 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-85923713-b068-4e8b-b065-4b7d8d32fd92 tempest-CreateVolumesFromImageTest-1067060639 None] Created volume successfully. Jul 08 02:57:19 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD" returned: 0 in 0.782s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:19 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD Jul 08 02:57:19 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:20 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dea2d54f-a416-413b-b144-5b5cb3824f7a 1073741824" returned: 0 in 0.864s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dea2d54f-a416-413b-b144-5b5cb3824f7a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:20 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dea2d54f-a416-413b-b144-5b5cb3824f7a Jul 08 02:57:20 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:20 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD" returned: 1 in 0.754s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:57:20 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Temporary image c554e11c-cba0-4290-ac6e-444121f67a51 is fetched for user 56986b561ddd4df2a202967a0040d587. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 02:57:20 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c89df60-1851-4912-98e7-3a6cc5ffdec4]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:20 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD Jul 08 02:57:20 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:21 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dea2d54f-a416-413b-b144-5b5cb3824f7a" returned: 0 in 0.673s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.557s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-286957451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98c1439b30f40659ec191e26a8cf57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:15Z,use_quota=True,user_id='90715228d23e42dd81715344bc0d64e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Creating volume 2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:57:21 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccddaec0-729c-40ec-b162-8c357a6d11d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea2d54f-a416-413b-b144-5b5cb3824f7a', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:21 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 1073741824 Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adcb8b1-fc0d-4c4d-86c8-f78f5250c831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:21 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:21 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Volume volume-dea2d54f-a416-413b-b144-5b5cb3824f7a (dea2d54f-a416-413b-b144-5b5cb3824f7a): created successfully Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adcb8b1-fc0d-4c4d-86c8-f78f5250c831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Flow 'volume_create_manager' (a02ceaa3-a91c-4eb3-bdd2-deadb58a70b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:21 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-d54ced13-49a4-4408-ad86-4ae0a23054e2 tempest-CreateVolumesFromImageTest-1067060639 None] Created volume successfully. Jul 08 02:57:21 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:21 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD Jul 08 02:57:21 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:22 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 1073741824" returned: 0 in 0.826s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:22 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 Jul 08 02:57:22 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:22 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD" returned: 1 in 0.726s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:22 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3" returned: 0 in 0.671s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.905s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-957698013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa2fe92-c214-43ce-9ef8-fc263124e882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e0c6c8f8b64152a801a9507038906d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:16Z,use_quota=True,user_id='7eb1d8942a0a43dd8dc2e7938a172a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Creating volume 6aa2fe92-c214-43ce-9ef8-fc263124e882 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:57:22 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6aa2fe92-c214-43ce-9ef8-fc263124e882 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:22 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6aa2fe92-c214-43ce-9ef8-fc263124e882 1073741824 Jul 08 02:57:22 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd42e306-0314-4bd9-a476-05c575225f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72384c0-6d8c-4266-b614-cd2c7f85ce4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:22 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Volume volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 (2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3): created successfully Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72384c0-6d8c-4266-b614-cd2c7f85ce4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:22 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Flow 'volume_create_manager' (41e2917f-6e09-4195-bb34-ee5363596b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:22 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ae122e15-20cd-40f1-99f2-67be91071e3a tempest-ProjectReaderTests-1467205220 None] Created volume successfully. Jul 08 02:57:23 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6aa2fe92-c214-43ce-9ef8-fc263124e882 1073741824" returned: 0 in 0.812s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6aa2fe92-c214-43ce-9ef8-fc263124e882 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:23 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6aa2fe92-c214-43ce-9ef8-fc263124e882 Jul 08 02:57:23 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:24 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6aa2fe92-c214-43ce-9ef8-fc263124e882" returned: 0 in 0.682s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.078s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2036638728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d40fb733-6349-4231-b9a1-d3a39332e07e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e0c6c8f8b64152a801a9507038906d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:16Z,use_quota=True,user_id='7eb1d8942a0a43dd8dc2e7938a172a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Creating volume d40fb733-6349-4231-b9a1-d3a39332e07e {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:57:24 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d40fb733-6349-4231-b9a1-d3a39332e07e 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170fcf93-30b3-4e67-ad50-a4cc74d3caca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aa2fe92-c214-43ce-9ef8-fc263124e882', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:24 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d40fb733-6349-4231-b9a1-d3a39332e07e 1073741824 Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3f9048-fd61-46f4-9903-03f08cbfbc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:24 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:24 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Volume volume-6aa2fe92-c214-43ce-9ef8-fc263124e882 (6aa2fe92-c214-43ce-9ef8-fc263124e882): created successfully Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3f9048-fd61-46f4-9903-03f08cbfbc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Flow 'volume_create_manager' (99601761-aa84-4dbe-897c-510296c46971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:24 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-435d0840-47a8-4740-b7b7-f5b0f397850b tempest-CreateVolumesFromImageTest-1067060639 None] Created volume successfully. Jul 08 02:57:25 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d40fb733-6349-4231-b9a1-d3a39332e07e 1073741824" returned: 0 in 0.809s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d40fb733-6349-4231-b9a1-d3a39332e07e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:25 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d40fb733-6349-4231-b9a1-d3a39332e07e Jul 08 02:57:25 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:25 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d40fb733-6349-4231-b9a1-d3a39332e07e" returned: 0 in 0.623s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:57:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.015s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Creating offline snapshot 761d826b-2ae6-48a9-bac3-a9ac634d2578 of volume b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:57:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8864c9d0-f597-45c4-a975-382a04d41c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d40fb733-6349-4231-b9a1-d3a39332e07e', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc2da00-526a-4df5-8218-3a49022f9bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:25 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0240abfb-0ca3-4a10-b067-fb00dfe4764d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:25 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Volume volume-d40fb733-6349-4231-b9a1-d3a39332e07e (d40fb733-6349-4231-b9a1-d3a39332e07e): created successfully Jul 08 02:57:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc2da00-526a-4df5-8218-3a49022f9bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:25 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Flow 'volume_create_manager' (ba319dd8-6523-43aa-bdf6-6956e034903f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:25 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-43e01e6f-a641-4386-b512-46573e57bf6a tempest-CreateVolumesFromImageTest-1067060639 None] Created volume successfully. Jul 08 02:57:25 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 Jul 08 02:57:25 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "cinder-d40fb733-6349-4231-b9a1-d3a39332e07e-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-d40fb733-6349-4231-b9a1-d3a39332e07e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "cinder-quobyte-d40fb733-6349-4231-b9a1-d3a39332e07e" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-quobyte-d40fb733-6349-4231-b9a1-d3a39332e07e" acquired by "delete_volume" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:26 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5a1ef8-26b7-4e91-af2a-4225ab9c288e]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d40fb733-6349-4231-b9a1-d3a39332e07e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:26 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d40fb733-6349-4231-b9a1-d3a39332e07e Jul 08 02:57:26 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:26 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840" returned: 0 in 0.782s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:26 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578 1G Jul 08 02:57:26 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:26 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d40fb733-6349-4231-b9a1-d3a39332e07e" returned: 0 in 0.788s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d40fb733-6349-4231-b9a1-d3a39332e07e {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:26 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d40fb733-6349-4231-b9a1-d3a39332e07e Jul 08 02:57:26 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:27 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578 1G" returned: 0 in 0.813s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:27 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578 Jul 08 02:57:27 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:27 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d40fb733-6349-4231-b9a1-d3a39332e07e" returned: 0 in 0.686s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-quobyte-d40fb733-6349-4231-b9a1-d3a39332e07e" released by "delete_volume" :: held 1.523s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:27 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Created reservations ['4e3b90eb-b0e5-4a6c-af38-ea92867eed41', 'de54df85-d0ac-48a0-a041-19dc80440a04', 'da46c850-ea31-410b-b5b2-b9edaac7c435', '630eb649-b890-4d31-aa83-729f03cba89b'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:57:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:27 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:57:27 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:28 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578" returned: 0 in 0.728s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:28 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578 is being set with open permissions: ugo+rw Jul 08 02:57:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:28 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578 Jul 08 02:57:28 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "cinder-6aa2fe92-c214-43ce-9ef8-fc263124e882-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-6aa2fe92-c214-43ce-9ef8-fc263124e882-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "cinder-quobyte-6aa2fe92-c214-43ce-9ef8-fc263124e882" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-quobyte-6aa2fe92-c214-43ce-9ef8-fc263124e882" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:28 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[d376a1d4-11c5-4968-9950-9281d82812e2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6aa2fe92-c214-43ce-9ef8-fc263124e882 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:28 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.729s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:28 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:57:28 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Deleted volume successfully. Jul 08 02:57:28 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6aa2fe92-c214-43ce-9ef8-fc263124e882 Jul 08 02:57:28 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5de5c915-f40a-4a6b-9ca5-6ad028dea24f tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-d40fb733-6349-4231-b9a1-d3a39332e07e-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:28 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578" returned: 0 in 0.686s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:28 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.info Jul 08 02:57:28 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:29 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6aa2fe92-c214-43ce-9ef8-fc263124e882" returned: 0 in 0.808s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6aa2fe92-c214-43ce-9ef8-fc263124e882 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:29 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6aa2fe92-c214-43ce-9ef8-fc263124e882 Jul 08 02:57:29 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:29 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.info" returned: 0 in 0.677s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:29 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.info is being set with open permissions: ugo+rw Jul 08 02:57:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:29 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.info Jul 08 02:57:29 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:29 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6aa2fe92-c214-43ce-9ef8-fc263124e882" returned: 0 in 0.666s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-quobyte-6aa2fe92-c214-43ce-9ef8-fc263124e882" released by "delete_volume" :: held 1.520s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:29 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Created reservations ['a0562c2b-16d8-4d9e-ae15-073c8aa3f947', '9f609cfb-379a-4c12-a495-10d9d2883774', 'c6492153-6141-4f50-846d-8640d2057285', '6b3fad30-b53d-41c1-a02a-1a9376623ac2'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:57:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:29 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:57:29 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:30 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.info" returned: 0 in 0.680s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.483s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.097s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96b21d5-9d6f-4be1-9ebd-888ea9b40946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02d42573c454440b2cf11d368426098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:18Z,use_quota=True,user_id='56986b561ddd4df2a202967a0040d587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(222610e7-a792-4812-9aaa-815fc673d733),volume_type_id=222610e7-a792-4812-9aaa-815fc673d733)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Creating volume f96b21d5-9d6f-4be1-9ebd-888ea9b40946 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:57:30 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:30 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 1073741824 Jul 08 02:57:30 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:30 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c0fb8471-ab65-49b9-b987-ad1874b77962 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Create snapshot completed successfully Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "cinder-dea2d54f-a416-413b-b144-5b5cb3824f7a-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-dea2d54f-a416-413b-b144-5b5cb3824f7a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "cinder-quobyte-dea2d54f-a416-413b-b144-5b5cb3824f7a" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-quobyte-dea2d54f-a416-413b-b144-5b5cb3824f7a" acquired by "delete_volume" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91c39da-50e1-43cb-b966-6c4cd868e7b7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dea2d54f-a416-413b-b144-5b5cb3824f7a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:30 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.736s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:57:30 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Deleted volume successfully. Jul 08 02:57:30 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dea2d54f-a416-413b-b144-5b5cb3824f7a Jul 08 02:57:30 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:30 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-dedea8cc-e388-4e95-b97e-705e060e9813 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-6aa2fe92-c214-43ce-9ef8-fc263124e882-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:31 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 1073741824" returned: 0 in 0.899s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:31 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 Jul 08 02:57:31 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:31 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dea2d54f-a416-413b-b144-5b5cb3824f7a" returned: 0 in 0.839s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dea2d54f-a416-413b-b144-5b5cb3824f7a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:31 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dea2d54f-a416-413b-b144-5b5cb3824f7a Jul 08 02:57:31 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:31 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Flow 'volume_create_manager' (c5a68a97-65c2-4c5f-8f26-dee36a3d44d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da295254-007f-4bda-9175-ec193609cc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da295254-007f-4bda-9175-ec193609cc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-937345619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4df654-ee3a-4103-963e-45799218eb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1a956194e841f5977dc3591f7de37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:32Z,use_quota=True,user_id='a11340f3614a46cdb12be2a8353f9844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341a2f93-0ddb-4603-9433-6d2a1afa2232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341a2f93-0ddb-4603-9433-6d2a1afa2232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d8750b-ff0c-4075-8b93-5fdb1669c25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d8750b-ff0c-4075-8b93-5fdb1669c25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4df654-ee3a-4103-963e-45799218eb19', 'volume_name': 'volume-2c4df654-ee3a-4103-963e-45799218eb19', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3251dfc-0581-4e24-8f5e-9d2f254df847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3251dfc-0581-4e24-8f5e-9d2f254df847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ad5f58-ba68-4ebd-9331-fdb665b5ca5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:31 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume 2c4df654-ee3a-4103-963e-45799218eb19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4df654-ee3a-4103-963e-45799218eb19', 'volume_size': 1} Jul 08 02:57:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:32 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946" returned: 0 in 0.803s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.954s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] Creating offline snapshot f2f89b31-8ee5-436c-b94c-eda772eda811 of volume 2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1311bcf4-a789-43d2-b9e5-381700dd106a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Attempting download of c554e11c-cba0-4290-ac6e-444121f67a51 ((None, [{'url': 'file:///opt/stack/data/glance/images/c554e11c-cba0-4290-ac6e-444121f67a51', 'metadata': {}}])) to volume f96b21d5-9d6f-4be1-9ebd-888ea9b40946. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bab540-9d2e-420a-87e4-1624dffb1957]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c554e11c-cba0-4290-ac6e-444121f67a51_har1himl {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:32 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 Jul 08 02:57:32 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Flow 'volume_create_manager' (58e9e8dd-51a1-4e80-aef1-19764d5a1f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2dcb13-03de-42b9-8403-a1d9ccd2a72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:32 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c554e11c-cba0-4290-ac6e-444121f67a51_har1himl Jul 08 02:57:32 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:32 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2dcb13-03de-42b9-8403-a1d9ccd2a72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-622046260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8c0745-b192-4d90-b710-cfda8ed79fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1a956194e841f5977dc3591f7de37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:32Z,use_quota=True,user_id='a11340f3614a46cdb12be2a8353f9844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f3a267-a023-464c-866b-27501b335122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f3a267-a023-464c-866b-27501b335122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596f90c0-987e-40bb-9210-628bcabce027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596f90c0-987e-40bb-9210-628bcabce027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff8c0745-b192-4d90-b710-cfda8ed79fe2', 'volume_name': 'volume-ff8c0745-b192-4d90-b710-cfda8ed79fe2', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03664a0f-d1b5-4336-9b87-04509ca10815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03664a0f-d1b5-4336-9b87-04509ca10815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd2581f-e557-4392-accc-ebf210f430c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:32 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume ff8c0745-b192-4d90-b710-cfda8ed79fe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff8c0745-b192-4d90-b710-cfda8ed79fe2', 'volume_size': 1} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-dea2d54f-a416-413b-b144-5b5cb3824f7a" returned: 0 in 1.207s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-quobyte-dea2d54f-a416-413b-b144-5b5cb3824f7a" released by "delete_volume" :: held 2.112s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Created reservations ['e0271be5-7fc7-41d5-88cf-559777deb36b', '0d9a188b-df1a-4290-b473-18c78c50309b', '7a7f1a8b-da6e-42b7-9f0b-d856b319b75c', '5b06dd25-ef3a-4490-bef9-66101f8154e8'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:32 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:57:32 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Flow 'volume_create_manager' (ad120600-3d27-4bb6-993c-440daf18acfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588e6003-528c-4fa6-b97f-08fbb0506a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588e6003-528c-4fa6-b97f-08fbb0506a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1291106251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60be7c31-d203-4245-a0b9-0e249229d580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1a956194e841f5977dc3591f7de37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:33Z,use_quota=True,user_id='a11340f3614a46cdb12be2a8353f9844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a355e84-0bf4-4f89-9d81-990221b7a832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a355e84-0bf4-4f89-9d81-990221b7a832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8339070-99c8-4c3e-a823-24c16b215c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8339070-99c8-4c3e-a823-24c16b215c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60be7c31-d203-4245-a0b9-0e249229d580', 'volume_name': 'volume-60be7c31-d203-4245-a0b9-0e249229d580', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad172f1-007e-45f1-ad8b-3c53801f31de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad172f1-007e-45f1-ad8b-3c53801f31de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e558679f-89ad-49e4-a53b-c23f65613895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:33 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume 60be7c31-d203-4245-a0b9-0e249229d580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60be7c31-d203-4245-a0b9-0e249229d580', 'volume_size': 1} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:33 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3" returned: 0 in 1.236s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:33 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811 1G Jul 08 02:57:33 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:33 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c554e11c-cba0-4290-ac6e-444121f67a51_har1himl" returned: 0 in 1.129s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c554e11c-cba0-4290-ac6e-444121f67a51_har1himl {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Flow 'volume_create_manager' (5083f5f5-51d0-4e67-b850-b03fa27c790e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c58db0-8cfe-495a-b4a8-8ff73eed8ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c58db0-8cfe-495a-b4a8-8ff73eed8ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2108957125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1a956194e841f5977dc3591f7de37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:33Z,use_quota=True,user_id='a11340f3614a46cdb12be2a8353f9844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b4db22-0321-42fe-9212-d2541d0380cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b4db22-0321-42fe-9212-d2541d0380cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c131c8-8fe8-4193-a593-16f768388b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c131c8-8fe8-4193-a593-16f768388b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7', 'volume_name': 'volume-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:33 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c554e11c-cba0-4290-ac6e-444121f67a51_har1himl Jul 08 02:57:33 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc1cda6-bffa-4669-8645-7f468818675c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc1cda6-bffa-4669-8645-7f468818675c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66958f7b-b40e-4f40-849f-eb3aeecebb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:33 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume 4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7', 'volume_size': 1} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:33 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.879s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:57:33 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Deleted volume successfully. Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6527575d-3c7e-4eff-81b5-314b7fa04646 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-dea2d54f-a416-413b-b144-5b5cb3824f7a-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "cinder-00806860-5c1d-48be-993d-d75d510195f5-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-00806860-5c1d-48be-993d-d75d510195f5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Flow 'volume_create_manager' (f51b838e-8670-4499-91a6-607c5a048ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2302069-5707-4a6b-8033-c8b8bdedc7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2302069-5707-4a6b-8033-c8b8bdedc7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-527240926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d1a5f0-915f-4700-93ef-10029dabc36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1a956194e841f5977dc3591f7de37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:34Z,use_quota=True,user_id='a11340f3614a46cdb12be2a8353f9844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb79e928-0440-4b24-bd10-22fdcaf47439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb79e928-0440-4b24-bd10-22fdcaf47439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea91f7ed-1bf2-44ba-9c4c-8101880e801b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea91f7ed-1bf2-44ba-9c4c-8101880e801b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d1a5f0-915f-4700-93ef-10029dabc36c', 'volume_name': 'volume-48d1a5f0-915f-4700-93ef-10029dabc36c', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f78e22-6800-42e1-a59e-8f13e620c958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f78e22-6800-42e1-a59e-8f13e620c958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30b1ecb-b5bc-4cc4-be75-a885f90be692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:34 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume 48d1a5f0-915f-4700-93ef-10029dabc36c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d1a5f0-915f-4700-93ef-10029dabc36c', 'volume_size': 1} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "cinder-quobyte-00806860-5c1d-48be-993d-d75d510195f5" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-quobyte-00806860-5c1d-48be-993d-d75d510195f5" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a440e7-b357-4008-a1b6-03ababd888dc]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00806860-5c1d-48be-993d-d75d510195f5 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:34 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00806860-5c1d-48be-993d-d75d510195f5 Jul 08 02:57:34 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:34 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c554e11c-cba0-4290-ac6e-444121f67a51_har1himl" returned: 1 in 1.020s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c554e11c-cba0-4290-ac6e-444121f67a51_har1himl' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[182dd5a1-2d8e-463f-9ebd-7a755a23e870]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:34 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811 1G" returned: 0 in 1.112s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:34 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811 Jul 08 02:57:34 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:34 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD Jul 08 02:57:34 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:34 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00806860-5c1d-48be-993d-d75d510195f5" returned: 0 in 0.842s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00806860-5c1d-48be-993d-d75d510195f5 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:34 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00806860-5c1d-48be-993d-d75d510195f5 Jul 08 02:57:34 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:35 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:35 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811" returned: 0 in 0.748s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:35 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811 is being set with open permissions: ugo+rw Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:35 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811 Jul 08 02:57:35 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:35 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD Jul 08 02:57:35 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:35 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-00806860-5c1d-48be-993d-d75d510195f5" returned: 0 in 0.662s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-quobyte-00806860-5c1d-48be-993d-d75d510195f5" released by "delete_volume" :: held 1.548s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Created reservations ['223fcbc3-5ced-4705-924e-aabbf52fbc22', '9b965c44-7920-4843-99c3-8be91fb264b3', 'e290dfeb-9fc7-4249-a438-dfd5551af1d2', 'd6b9fad6-ca25-4e52-a8ef-48a35f07c0cd'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:35 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:57:35 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:35 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811" returned: 0 in 0.710s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:35 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD" returned: 1 in 0.788s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] c554e11c-cba0-4290-ac6e-444121f67a51 was raw, converting to raw {{(pid=87238) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 02:57:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:35 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.info Jul 08 02:57:35 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:35 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 Jul 08 02:57:35 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "cinder-eb5d9ff8-c50d-4dec-8c6b-142f0009093a-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-eb5d9ff8-c50d-4dec-8c6b-142f0009093a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "cinder-quobyte-eb5d9ff8-c50d-4dec-8c6b-142f0009093a" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-quobyte-eb5d9ff8-c50d-4dec-8c6b-142f0009093a" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:36 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01bc75f-e9df-4ff9-8fcc-8bed8e57b84b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eb5d9ff8-c50d-4dec-8c6b-142f0009093a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:36 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eb5d9ff8-c50d-4dec-8c6b-142f0009093a Jul 08 02:57:36 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:36 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.724s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:36 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:57:36 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Deleted volume successfully. Jul 08 02:57:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-42baae66-1968-43d7-926b-ec64479847cb tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-00806860-5c1d-48be-993d-d75d510195f5-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:36 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.info" returned: 0 in 0.776s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:36 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.info is being set with open permissions: ugo+rw Jul 08 02:57:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:36 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.info Jul 08 02:57:36 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:36 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946" returned: 0 in 0.864s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:36 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c554e11c-cba0-4290-ac6e-444121f67a51_eoa6mb4kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:57:36 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 02:57:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:36 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 1G Jul 08 02:57:36 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:37 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eb5d9ff8-c50d-4dec-8c6b-142f0009093a" returned: 0 in 0.838s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eb5d9ff8-c50d-4dec-8c6b-142f0009093a {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:37 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eb5d9ff8-c50d-4dec-8c6b-142f0009093a Jul 08 02:57:37 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:37 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.info" returned: 0 in 0.701s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.394s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.588s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-937345619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4df654-ee3a-4103-963e-45799218eb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1a956194e841f5977dc3591f7de37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:32Z,use_quota=True,user_id='a11340f3614a46cdb12be2a8353f9844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Creating volume 2c4df654-ee3a-4103-963e-45799218eb19 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:57:37 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4df654-ee3a-4103-963e-45799218eb19 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:37 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4df654-ee3a-4103-963e-45799218eb19 1073741824 Jul 08 02:57:37 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:37 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-65ad0d8d-f3e3-4a50-8530-a79f682f5c79 tempest-ProjectReaderTests-1467205220 None] Create snapshot completed successfully Jul 08 02:57:37 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 1G" returned: 0 in 0.720s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c9173c-c236-4636-8a45-2a5a74c0c442]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:37 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 Jul 08 02:57:37 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:37 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-f2f89b31-8ee5-436c-b94c-eda772eda811-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eb5d9ff8-c50d-4dec-8c6b-142f0009093a" returned: 0 in 0.807s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-quobyte-eb5d9ff8-c50d-4dec-8c6b-142f0009093a" released by "delete_volume" :: held 1.703s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Lock "cinder-f2f89b31-8ee5-436c-b94c-eda772eda811-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-quobyte-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-quobyte-f2f89b31-8ee5-436c-b94c-eda772eda811" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-f2f89b31-8ee5-436c-b94c-eda772eda811" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Deleting offline snapshot f2f89b31-8ee5-436c-b94c-eda772eda811 of volume 2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] snapshot_file for this snap is: volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83218d5-4dd9-4d95-b3ca-d0735806299b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Created reservations ['9fefe9c6-17da-4b51-8079-765f721e5bdc', 'a64f967d-59a3-4ade-b925-b6afb1547d79', 'a16c950f-6d6d-4017-b2c4-fe0e6832517f', '28890318-3bdb-4474-b4cd-4b539f80048d'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:38 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:57:38 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:38 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811 Jul 08 02:57:38 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:38 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4df654-ee3a-4103-963e-45799218eb19 1073741824" returned: 0 in 1.038s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4df654-ee3a-4103-963e-45799218eb19 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:38 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946" returned: 0 in 0.986s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:38 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4df654-ee3a-4103-963e-45799218eb19 Jul 08 02:57:38 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:38 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 Jul 08 02:57:38 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:39 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811" returned: 0 in 0.978s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bd3aef-9cf5-4a84-bdb7-c10cb59a66ac]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:39 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.947s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:57:39 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Deleted volume successfully. Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-cb388dde-a23f-4b3e-b782-5a6741deebc6 tempest-CreateVolumesFromImageTest-1067060639 None] Lock "cinder-eb5d9ff8-c50d-4dec-8c6b-142f0009093a-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:39 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 Jul 08 02:57:39 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:39 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4df654-ee3a-4103-963e-45799218eb19" returned: 0 in 1.001s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.116s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.922s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-622046260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8c0745-b192-4d90-b710-cfda8ed79fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1a956194e841f5977dc3591f7de37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:32Z,use_quota=True,user_id='a11340f3614a46cdb12be2a8353f9844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Creating volume ff8c0745-b192-4d90-b710-cfda8ed79fe2 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:57:39 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff8c0745-b192-4d90-b710-cfda8ed79fe2 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ad5f58-ba68-4ebd-9331-fdb665b5ca5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4df654-ee3a-4103-963e-45799218eb19', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01327005-4601-4789-947a-8c30546995d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:39 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:39 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff8c0745-b192-4d90-b710-cfda8ed79fe2 1073741824 Jul 08 02:57:39 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946" returned: 1 in 1.055s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Downloaded image c554e11c-cba0-4290-ac6e-444121f67a51 ((None, [{'url': 'file:///opt/stack/data/glance/images/c554e11c-cba0-4290-ac6e-444121f67a51', 'metadata': {}}])) to volume f96b21d5-9d6f-4be1-9ebd-888ea9b40946 successfully. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Temporary image c554e11c-cba0-4290-ac6e-444121f67a51 for user 56986b561ddd4df2a202967a0040d587 is deleted. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Marking volume f96b21d5-9d6f-4be1-9ebd-888ea9b40946 as bootable. {{(pid=87238) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 02:57:39 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume volume-2c4df654-ee3a-4103-963e-45799218eb19 (2c4df654-ee3a-4103-963e-45799218eb19): created successfully Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01327005-4601-4789-947a-8c30546995d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Flow 'volume_create_manager' (c5a68a97-65c2-4c5f-8f26-dee36a3d44d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Copying metadata from image c554e11c-cba0-4290-ac6e-444121f67a51 to f96b21d5-9d6f-4be1-9ebd-888ea9b40946. {{(pid=87238) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Creating volume glance metadata for volume f96b21d5-9d6f-4be1-9ebd-888ea9b40946 backed by image c554e11c-cba0-4290-ac6e-444121f67a51 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c554e11c-cba0-4290-ac6e-444121f67a51', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'dc71dd959d5a15b2ef3a8bab0c7cd882', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87238) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 02:57:39 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-abb9a18c-9b59-4077-9da5-640ccf995f0c tempest-CreateVolumesFromSnapshotTest-2019968664 None] Created volume successfully. Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50c1133-2dc8-4f68-aedb-aff3118b694b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946', 'volume_size': 1, 'image_id': 'c554e11c-cba0-4290-ac6e-444121f67a51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c554e11c-cba0-4290-ac6e-444121f67a51', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc71dd959d5a15b2ef3a8bab0c7cd882', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a02d42573c454440b2cf11d368426098', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a2a5a6399391de2213de3e839a74536245c4926c2de79c9ac2562e9cfd3eb9bb4ea126ba1216ad274191b0242fd97357bb6a7426c41866b621df68b7c921051', 'id': 'c554e11c-cba0-4290-ac6e-444121f67a51', 'created_at': datetime.datetime(2026, 7, 8, 0, 57, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c554e11c-cba0-4290-ac6e-444121f67a51/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b5d404-4637-462b-9c7e-6ef94c313637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:39 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Volume volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 (f96b21d5-9d6f-4be1-9ebd-888ea9b40946): created successfully Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b5d404-4637-462b-9c7e-6ef94c313637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Flow 'volume_create_manager' (14e7d700-f859-425a-9e26-7113e4fb1e49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:39 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-104df9b7-3fa5-47c5-97f4-c748597b5848 tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Created volume successfully. Jul 08 02:57:40 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Acquiring lock "cinder-f96b21d5-9d6f-4be1-9ebd-888ea9b40946-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:40 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3" returned: 0 in 1.012s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:40 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Lock "cinder-f96b21d5-9d6f-4be1-9ebd-888ea9b40946-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:40 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811 Jul 08 02:57:40 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:40 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Acquiring lock "cinder-quobyte-f96b21d5-9d6f-4be1-9ebd-888ea9b40946" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:40 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Lock "cinder-quobyte-f96b21d5-9d6f-4be1-9ebd-888ea9b40946" acquired by "delete_volume" :: waited 0.030s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:40 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd4cad8-5d78-4061-834e-069ffc593ad0]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:40 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 Jul 08 02:57:40 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:40 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff8c0745-b192-4d90-b710-cfda8ed79fe2 1073741824" returned: 0 in 1.101s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff8c0745-b192-4d90-b710-cfda8ed79fe2 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:40 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff8c0745-b192-4d90-b710-cfda8ed79fe2 Jul 08 02:57:40 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:41 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811" returned: 0 in 0.939s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:41 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811 Jul 08 02:57:41 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:41 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946" returned: 0 in 0.933s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:41 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 Jul 08 02:57:41 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:41 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff8c0745-b192-4d90-b710-cfda8ed79fe2" returned: 0 in 0.870s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.355s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1291106251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60be7c31-d203-4245-a0b9-0e249229d580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1a956194e841f5977dc3591f7de37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:33Z,use_quota=True,user_id='a11340f3614a46cdb12be2a8353f9844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Creating volume 60be7c31-d203-4245-a0b9-0e249229d580 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:57:41 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-60be7c31-d203-4245-a0b9-0e249229d580 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd2581f-e557-4392-accc-ebf210f430c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff8c0745-b192-4d90-b710-cfda8ed79fe2', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:41 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-60be7c31-d203-4245-a0b9-0e249229d580 1073741824 Jul 08 02:57:41 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaacee4a-3d8d-4361-9843-bf50f89d762d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:41 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume volume-ff8c0745-b192-4d90-b710-cfda8ed79fe2 (ff8c0745-b192-4d90-b710-cfda8ed79fe2): created successfully Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaacee4a-3d8d-4361-9843-bf50f89d762d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Flow 'volume_create_manager' (58e9e8dd-51a1-4e80-aef1-19764d5a1f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:41 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-1285fdf5-9221-4833-9cc9-62322257fc7b tempest-CreateVolumesFromSnapshotTest-2019968664 None] Created volume successfully. Jul 08 02:57:41 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3.f2f89b31-8ee5-436c-b94c-eda772eda811" returned: 0 in 0.811s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-f2f89b31-8ee5-436c-b94c-eda772eda811" released by "_delete_snapshot" :: held 3.889s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:41 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3" released by "delete_snapshot" :: held 3.923s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Created reservations ['72487c0e-2b82-4d7e-a5e5-bff77af35364', 'dba42fea-218e-4390-959a-85b8034c0752', 'e42a22c5-cb42-49b4-b9a2-2275100b1973', '70452de4-542d-4b8e-ad5a-9add3911db4f'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:57:42 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Delete snapshot completed successfully. Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0f070111-e2c1-4dd8-b1a3-94c84402bb5a tempest-ProjectReaderTests-1467205220 None] Lock "cinder-f2f89b31-8ee5-436c-b94c-eda772eda811-delete_snapshot" released by "delete_snapshot" :: held 4.130s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:42 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Flow 'volume_create_manager' (9463c998-47a8-4482-959a-6fcbba833c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94d8ebe-2c37-4963-b3f0-571da0f80809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946" returned: 1 in 0.996s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94d8ebe-2c37-4963-b3f0-571da0f80809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1158250874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6088288adc134744bbee008b12ab5248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:42Z,use_quota=True,user_id='90022f542cc741068a1a866d504ba336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6a8ab5-224f-44e8-be60-cbc39f23cdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:42 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946 Jul 08 02:57:42 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6a8ab5-224f-44e8-be60-cbc39f23cdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9080770-2212-449d-ab29-82e8c1dc0dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9080770-2212-449d-ab29-82e8c1dc0dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d', 'volume_name': 'volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67034626-c929-4cc1-ad37-5a4b923c190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67034626-c929-4cc1-ad37-5a4b923c190a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91eee6e4-f391-4e7f-b7dc-bc940b245879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:42 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Volume 112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d', 'volume_size': 1} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-quobyte-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1b0d49-8bfe-4bfb-872d-4dee529c242a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:42 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 Jul 08 02:57:42 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:42 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-60be7c31-d203-4245-a0b9-0e249229d580 1073741824" returned: 0 in 1.013s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-60be7c31-d203-4245-a0b9-0e249229d580 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:42 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-60be7c31-d203-4245-a0b9-0e249229d580 Jul 08 02:57:42 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:43 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f96b21d5-9d6f-4be1-9ebd-888ea9b40946" returned: 0 in 0.744s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Lock "cinder-quobyte-f96b21d5-9d6f-4be1-9ebd-888ea9b40946" released by "delete_volume" :: held 2.784s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Created reservations ['606911e7-c459-451b-999f-009c5f86bba0', '0131ab2e-ee69-412f-af2b-0404056c11aa', 'ecbabad6-e826-44ad-a4bb-24d7788ffb7d', '296f7e2b-3a8e-4e8f-a74a-d572e249b19d'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:43 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:57:43 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:43 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3" returned: 0 in 0.834s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:43 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3 Jul 08 02:57:43 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:43 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-60be7c31-d203-4245-a0b9-0e249229d580" returned: 0 in 0.691s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.723s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2108957125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1a956194e841f5977dc3591f7de37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:33Z,use_quota=True,user_id='a11340f3614a46cdb12be2a8353f9844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Creating volume 4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:57:43 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e558679f-89ad-49e4-a53b-c23f65613895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60be7c31-d203-4245-a0b9-0e249229d580', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:43 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7 1073741824 Jul 08 02:57:43 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef40aee-4d77-4da6-8f41-b9c0577244e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:43 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume volume-60be7c31-d203-4245-a0b9-0e249229d580 (60be7c31-d203-4245-a0b9-0e249229d580): created successfully Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef40aee-4d77-4da6-8f41-b9c0577244e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Flow 'volume_create_manager' (ad120600-3d27-4bb6-993c-440daf18acfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:43 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-002fb2d0-d1d0-48b8-af75-43fae4795e93 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Created volume successfully. Jul 08 02:57:43 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.726s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:57:43 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Deleted volume successfully. Jul 08 02:57:43 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7412360a-c293-4dec-8440-7b6abdf3f17f tempest-VolumeAndVolumeTypeFromImageTest-1087474227 None] Lock "cinder-f96b21d5-9d6f-4be1-9ebd-888ea9b40946-delete_volume" released by "delete_volume" :: held 3.812s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:44 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3" returned: 0 in 0.871s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:44 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3" released by "delete_volume" :: held 1.775s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:44 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Created reservations ['be4c8d65-2586-4268-92c0-6125710b7894', 'cafd3f03-8a8b-4739-802f-dc6a1ea469c0', '920931b4-b284-435f-8b60-221fa12a9b78', 'b29acdfc-ff42-4087-82a9-dee611f247b4'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:57:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:44 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:44 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:44 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:44 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:57:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7 1073741824" returned: 0 in 1.005s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:44 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:44 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7 Jul 08 02:57:44 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Flow 'volume_create_manager' (287b3995-c97e-4d2f-bece-b088eaf821a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c12741-8f06-4d99-b3d1-16892c528d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c12741-8f06-4d99-b3d1-16892c528d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-531391986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5dde875-c053-4627-9979-1adc9626fec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98c1439b30f40659ec191e26a8cf57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:45Z,use_quota=True,user_id='90715228d23e42dd81715344bc0d64e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0953bf2-1d29-4252-8c29-205fd50de037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0953bf2-1d29-4252-8c29-205fd50de037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd3ab99-5ac4-42e6-9851-df54a9b51bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd3ab99-5ac4-42e6-9851-df54a9b51bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5dde875-c053-4627-9979-1adc9626fec2', 'volume_name': 'volume-e5dde875-c053-4627-9979-1adc9626fec2', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f07137-8580-414f-9b1f-40a12d5581c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f07137-8580-414f-9b1f-40a12d5581c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ad1c3b-ab5a-4324-9a94-136cdda6b77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:45 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Volume e5dde875-c053-4627-9979-1adc9626fec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5dde875-c053-4627-9979-1adc9626fec2', 'volume_size': 1} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:45 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.851s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:57:45 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Deleted volume successfully. Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d9905725-d162-4706-94ec-d8c497df5243 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-2f8b7ad2-a4bb-43a9-827a-4ece87c3b2c3-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:45 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7" returned: 0 in 0.932s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.313s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-527240926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d1a5f0-915f-4700-93ef-10029dabc36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1a956194e841f5977dc3591f7de37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:34Z,use_quota=True,user_id='a11340f3614a46cdb12be2a8353f9844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Creating volume 48d1a5f0-915f-4700-93ef-10029dabc36c {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:57:45 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-48d1a5f0-915f-4700-93ef-10029dabc36c 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:45 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-48d1a5f0-915f-4700-93ef-10029dabc36c 1073741824 Jul 08 02:57:45 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66958f7b-b40e-4f40-849f-eb3aeecebb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83129aab-9df6-4bac-bb56-43fc171f69d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:45 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume volume-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7 (4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7): created successfully Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83129aab-9df6-4bac-bb56-43fc171f69d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Flow 'volume_create_manager' (5083f5f5-51d0-4e67-b850-b03fa27c790e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:45 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-50cdf4ab-91f8-410a-82a0-877dda7ddddc tempest-CreateVolumesFromSnapshotTest-2019968664 None] Created volume successfully. Jul 08 02:57:46 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-48d1a5f0-915f-4700-93ef-10029dabc36c 1073741824" returned: 0 in 0.928s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-48d1a5f0-915f-4700-93ef-10029dabc36c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:46 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-48d1a5f0-915f-4700-93ef-10029dabc36c Jul 08 02:57:46 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:47 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-48d1a5f0-915f-4700-93ef-10029dabc36c" returned: 0 in 0.687s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.667s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1158250874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6088288adc134744bbee008b12ab5248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:42Z,use_quota=True,user_id='90022f542cc741068a1a866d504ba336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Creating volume 112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:57:47 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:47 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d 1073741824 Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30b1ecb-b5bc-4cc4-be75-a885f90be692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d1a5f0-915f-4700-93ef-10029dabc36c', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:47 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da8890d-1c12-4b5c-882a-e2a79e057c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:47 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Volume volume-48d1a5f0-915f-4700-93ef-10029dabc36c (48d1a5f0-915f-4700-93ef-10029dabc36c): created successfully Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da8890d-1c12-4b5c-882a-e2a79e057c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Flow 'volume_create_manager' (f51b838e-8670-4499-91a6-607c5a048ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:47 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-43bcc10a-b780-4f40-9567-01ed69faa3c5 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Created volume successfully. Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:47 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:57:47 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "cinder-48d1a5f0-915f-4700-93ef-10029dabc36c-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-48d1a5f0-915f-4700-93ef-10029dabc36c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "cinder-quobyte-48d1a5f0-915f-4700-93ef-10029dabc36c" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-quobyte-48d1a5f0-915f-4700-93ef-10029dabc36c" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bd21f7-a12e-4810-a3f1-1ba453aebcef]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-48d1a5f0-915f-4700-93ef-10029dabc36c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:47 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-48d1a5f0-915f-4700-93ef-10029dabc36c Jul 08 02:57:47 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:48 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d 1073741824" returned: 0 in 0.969s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:48 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d Jul 08 02:57:48 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:48 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.828s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:57:48 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-48d1a5f0-915f-4700-93ef-10029dabc36c" returned: 0 in 0.894s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-48d1a5f0-915f-4700-93ef-10029dabc36c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:48 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-48d1a5f0-915f-4700-93ef-10029dabc36c Jul 08 02:57:48 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Flow 'volume_create_manager' (5e1713f1-8771-40c2-9802-d972cfd271e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5350e7-831d-40b3-a0b7-5f5bd0a6081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5350e7-831d-40b3-a0b7-5f5bd0a6081a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-519359242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c7ace07aed4fc39114ff15983dee58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:49Z,use_quota=True,user_id='57b2a8790f584b22af3ed5c4c36e108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d3760b-2471-488d-8ae7-08e288dcd4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d3760b-2471-488d-8ae7-08e288dcd4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2286822-d9e7-4b8f-873a-6dcacff87147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2286822-d9e7-4b8f-873a-6dcacff87147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05', 'volume_name': 'volume-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c307396-2369-447b-b430-c1b89ca5e817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c307396-2369-447b-b430-c1b89ca5e817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49368d30-7a11-49e9-91b0-5dd9627d6cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:48 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05', 'volume_size': 1} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:48 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d" returned: 0 in 0.757s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.660s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-531391986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5dde875-c053-4627-9979-1adc9626fec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98c1439b30f40659ec191e26a8cf57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:45Z,use_quota=True,user_id='90715228d23e42dd81715344bc0d64e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Creating volume e5dde875-c053-4627-9979-1adc9626fec2 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:57:48 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91eee6e4-f391-4e7f-b7dc-bc940b245879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:48 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2 1073741824 Jul 08 02:57:48 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0bfd732-dbb2-4f96-aec5-a6d91aef0986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:48 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Volume volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d (112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d): created successfully Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0bfd732-dbb2-4f96-aec5-a6d91aef0986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Flow 'volume_create_manager' (9463c998-47a8-4482-959a-6fcbba833c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:48 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-15c6d638-69f6-459e-8fb1-ef79f0699ce3 tempest-VolumeDependencyTests-1682053107 None] Created volume successfully. Jul 08 02:57:49 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-48d1a5f0-915f-4700-93ef-10029dabc36c" returned: 0 in 0.660s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-quobyte-48d1a5f0-915f-4700-93ef-10029dabc36c" released by "delete_volume" :: held 1.616s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Created reservations ['12cecde1-0325-4d9f-8e53-b0c8c6c57de4', 'c3c2c164-0472-4a13-a92c-37a849f5471f', 'b99a80a4-7232-4596-ab57-fd9b866ce070', '00532946-14bb-4cd2-8f0f-f248b3bec61d'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:49 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:57:49 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "cinder-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "cinder-quobyte-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-quobyte-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da26a39-007f-4a01-984e-2cb202d8f18f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:49 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2 1073741824" returned: 0 in 0.978s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:49 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2 Jul 08 02:57:49 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:49 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7 Jul 08 02:57:49 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:49 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.728s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:57:49 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Deleted volume successfully. Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-277d9686-7922-453c-9cfe-88508537fb90 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-48d1a5f0-915f-4700-93ef-10029dabc36c-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:50 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2" returned: 0 in 0.700s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.883s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-519359242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c7ace07aed4fc39114ff15983dee58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:49Z,use_quota=True,user_id='57b2a8790f584b22af3ed5c4c36e108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Creating volume cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:57:50 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:50 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05 1073741824 Jul 08 02:57:50 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ad1c3b-ab5a-4324-9a94-136cdda6b77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5dde875-c053-4627-9979-1adc9626fec2', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d29a8d5-7df9-4093-8224-6c728eb099cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:50 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Volume volume-e5dde875-c053-4627-9979-1adc9626fec2 (e5dde875-c053-4627-9979-1adc9626fec2): created successfully Jul 08 02:57:50 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d29a8d5-7df9-4093-8224-6c728eb099cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Flow 'volume_create_manager' (287b3995-c97e-4d2f-bece-b088eaf821a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7" returned: 0 in 0.866s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:50 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e2eec4d1-d330-48cc-85c3-05172eb6c6ce tempest-ProjectReaderTests-1467205220 None] Created volume successfully. Jul 08 02:57:50 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7 Jul 08 02:57:50 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:51 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7" returned: 0 in 0.658s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-quobyte-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7" released by "delete_volume" :: held 1.575s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Created reservations ['0c2e3b3f-a68d-4f25-b159-163dd7a2f0ca', 'e33b7358-917a-42c5-9e8b-2bd47b799687', '99aa8867-502c-4571-be54-23e527e83ebc', '7e7b119b-3d42-434b-814f-3f9749e0dcd4'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:51 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:57:51 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:51 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05 1073741824" returned: 0 in 0.916s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:51 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05 Jul 08 02:57:51 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "cinder-60be7c31-d203-4245-a0b9-0e249229d580-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-60be7c31-d203-4245-a0b9-0e249229d580-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "cinder-quobyte-60be7c31-d203-4245-a0b9-0e249229d580" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-quobyte-60be7c31-d203-4245-a0b9-0e249229d580" acquired by "delete_volume" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc4e005-2257-4f69-a314-05ba497e9606]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-60be7c31-d203-4245-a0b9-0e249229d580 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:52 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-60be7c31-d203-4245-a0b9-0e249229d580 Jul 08 02:57:52 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:52 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.728s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:52 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:57:52 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Deleted volume successfully. Jul 08 02:57:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-936a1f02-ed4a-43f5-b0bd-391d7b1e02f1 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-4ece3f6f-22f7-4f6a-a672-d62d1daf4ec7-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:52 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05" returned: 0 in 0.702s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:57:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.224s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49368d30-7a11-49e9-91b0-5dd9627d6cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbb4419-3e06-4ebd-ada0-028e069dfbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] Creating offline snapshot 21e5c640-29ab-4010-8d08-0d5f83af8840 of volume 112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:57:52 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume volume-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05 (cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05): created successfully Jul 08 02:57:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbb4419-3e06-4ebd-ada0-028e069dfbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Flow 'volume_create_manager' (5e1713f1-8771-40c2-9802-d972cfd271e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:52 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d77cce1-8e68-4ce1-ace5-653417716d34]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:52 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-603bc08c-271f-4b13-bcd1-387b5af19ca6 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Created volume successfully. Jul 08 02:57:52 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d Jul 08 02:57:52 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:52 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-60be7c31-d203-4245-a0b9-0e249229d580" returned: 0 in 0.800s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-60be7c31-d203-4245-a0b9-0e249229d580 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:52 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-60be7c31-d203-4245-a0b9-0e249229d580 Jul 08 02:57:52 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:53 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d" returned: 0 in 0.847s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:53 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 1G Jul 08 02:57:53 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Flow 'volume_create_manager' (751a9261-5d62-40e0-9637-a3f8ca9cba0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffa8159-b387-4c48-89e7-1447e1483d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffa8159-b387-4c48-89e7-1447e1483d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-717398957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59bf3ba-f869-46c6-9f34-562e63be6954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c7ace07aed4fc39114ff15983dee58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:53Z,use_quota=True,user_id='57b2a8790f584b22af3ed5c4c36e108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe2659a-931b-49da-af0d-9bf2e3b7a39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe2659a-931b-49da-af0d-9bf2e3b7a39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e220058c-9a23-46a2-a5ee-ddeae31d022e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e220058c-9a23-46a2-a5ee-ddeae31d022e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e59bf3ba-f869-46c6-9f34-562e63be6954', 'volume_name': 'volume-e59bf3ba-f869-46c6-9f34-562e63be6954', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f427ac78-07ac-43e2-b762-c5a188df4ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f427ac78-07ac-43e2-b762-c5a188df4ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1997fb3c-4afa-4a1c-8467-2c8e62ddcc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:53 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume e59bf3ba-f869-46c6-9f34-562e63be6954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e59bf3ba-f869-46c6-9f34-562e63be6954', 'volume_size': 1} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:53 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-60be7c31-d203-4245-a0b9-0e249229d580" returned: 0 in 0.695s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-quobyte-60be7c31-d203-4245-a0b9-0e249229d580" released by "delete_volume" :: held 1.558s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Created reservations ['70a30ac7-0425-4479-9171-6411c88f2aa2', '6a6113fc-9e83-4362-844f-3ee08ca51034', '1bc2d310-2e75-4d0b-8e25-1ba06972ce86', '9b238df2-a4e3-42ab-9452-f8acc6cb58da'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:53 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:57:53 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Flow 'volume_create_manager' (833f2931-e0cf-487b-bedd-2bca11a948de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61becdd5-fa7a-45a3-b392-7d41c6c6126e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61becdd5-fa7a-45a3-b392-7d41c6c6126e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1301356827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5a7fd5-770b-40aa-90dc-8ff9b7632375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c7ace07aed4fc39114ff15983dee58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:54Z,use_quota=True,user_id='57b2a8790f584b22af3ed5c4c36e108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9be624-f703-4db8-837a-58069c5674dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9be624-f703-4db8-837a-58069c5674dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4215e44-e5b3-4cba-a4b6-7f75b9366d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4215e44-e5b3-4cba-a4b6-7f75b9366d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc5a7fd5-770b-40aa-90dc-8ff9b7632375', 'volume_name': 'volume-bc5a7fd5-770b-40aa-90dc-8ff9b7632375', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ebfa24-7675-4ed7-b8fa-32cd627f6af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ebfa24-7675-4ed7-b8fa-32cd627f6af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121df109-376c-4f6c-aede-f5350d7a4f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:53 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume bc5a7fd5-770b-40aa-90dc-8ff9b7632375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc5a7fd5-770b-40aa-90dc-8ff9b7632375', 'volume_size': 1} Jul 08 02:57:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:54 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 1G" returned: 0 in 1.048s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "cinder-ff8c0745-b192-4d90-b710-cfda8ed79fe2-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:54 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 Jul 08 02:57:54 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Flow 'volume_create_manager' (195d5187-8e2b-4794-8c04-1e8da6c37382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c141fa5-29fc-41c0-8e97-422c223e39d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c141fa5-29fc-41c0-8e97-422c223e39d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-357219121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89674035-c0d6-41e2-8aef-81babda193e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c7ace07aed4fc39114ff15983dee58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:54Z,use_quota=True,user_id='57b2a8790f584b22af3ed5c4c36e108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162ff32e-84b3-4ca9-843d-f402a619f7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162ff32e-84b3-4ca9-843d-f402a619f7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151b6994-7254-4b5a-a6d5-a7fa7962628a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151b6994-7254-4b5a-a6d5-a7fa7962628a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89674035-c0d6-41e2-8aef-81babda193e0', 'volume_name': 'volume-89674035-c0d6-41e2-8aef-81babda193e0', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d834d9-3060-422c-bea7-d4a594a963dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d834d9-3060-422c-bea7-d4a594a963dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24e1db9-67b2-4661-971e-559afb09dae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:54 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume 89674035-c0d6-41e2-8aef-81babda193e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89674035-c0d6-41e2-8aef-81babda193e0', 'volume_size': 1} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-ff8c0745-b192-4d90-b710-cfda8ed79fe2-delete_volume" acquired by "delete_volume" :: waited 0.188s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "cinder-quobyte-ff8c0745-b192-4d90-b710-cfda8ed79fe2" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-quobyte-ff8c0745-b192-4d90-b710-cfda8ed79fe2" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:54 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.875s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:57:54 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Deleted volume successfully. Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b2aa1b-4388-47f9-8dc2-409bd4c16adb]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff8c0745-b192-4d90-b710-cfda8ed79fe2 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-95830bee-4fd2-4a09-8a45-6d0241eb4836 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-60be7c31-d203-4245-a0b9-0e249229d580-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Flow 'volume_create_manager' (9322f429-c48e-40ec-9f93-e3d321b1dcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913f6615-f2cd-43a2-8ae0-37f18d1faec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913f6615-f2cd-43a2-8ae0-37f18d1faec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-465958455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d31d057-064a-49e4-b3c0-fbad81708e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c7ace07aed4fc39114ff15983dee58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:55Z,use_quota=True,user_id='57b2a8790f584b22af3ed5c4c36e108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bf65ce-aee1-4a77-a708-d269f0e7aadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:54 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff8c0745-b192-4d90-b710-cfda8ed79fe2 Jul 08 02:57:54 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bf65ce-aee1-4a77-a708-d269f0e7aadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e9828d-6c2c-4cb9-8079-9c95bdbe67b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e9828d-6c2c-4cb9-8079-9c95bdbe67b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d31d057-064a-49e4-b3c0-fbad81708e41', 'volume_name': 'volume-7d31d057-064a-49e4-b3c0-fbad81708e41', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9b42b0-ab83-4d27-be5a-64b4261774bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9b42b0-ab83-4d27-be5a-64b4261774bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e78c64-459f-4ac0-b811-f57195bf8c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:54 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume 7d31d057-064a-49e4-b3c0-fbad81708e41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d31d057-064a-49e4-b3c0-fbad81708e41', 'volume_size': 1} Jul 08 02:57:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Flow 'volume_create_manager' (de10fbab-11f4-43d5-b272-c6e0081d8bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786296f2-4213-466c-94a1-07b7eacc54a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786296f2-4213-466c-94a1-07b7eacc54a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-60332889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6316f767-4ae0-491d-b7c2-0202d8a85bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c7ace07aed4fc39114ff15983dee58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:55Z,use_quota=True,user_id='57b2a8790f584b22af3ed5c4c36e108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:55 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4673b3-d416-45c2-aaab-9190c8b70c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4673b3-d416-45c2-aaab-9190c8b70c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70afc284-28b7-49ad-87f9-c8ac5974087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70afc284-28b7-49ad-87f9-c8ac5974087b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6316f767-4ae0-491d-b7c2-0202d8a85bdf', 'volume_name': 'volume-6316f767-4ae0-491d-b7c2-0202d8a85bdf', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76762a5d-01d2-4686-a5b8-0e6832370eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76762a5d-01d2-4686-a5b8-0e6832370eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62e330a-070d-46cb-990b-65a8bf60e83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:55 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume 6316f767-4ae0-491d-b7c2-0202d8a85bdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6316f767-4ae0-491d-b7c2-0202d8a85bdf', 'volume_size': 1} Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840" returned: 0 in 0.939s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:55 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 is being set with open permissions: ugo+rw Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:55 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 Jul 08 02:57:55 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:55 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff8c0745-b192-4d90-b710-cfda8ed79fe2" returned: 0 in 0.898s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff8c0745-b192-4d90-b710-cfda8ed79fe2 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:55 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff8c0745-b192-4d90-b710-cfda8ed79fe2 Jul 08 02:57:55 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:55 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840" returned: 0 in 0.670s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:55 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.info Jul 08 02:57:55 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:56 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ff8c0745-b192-4d90-b710-cfda8ed79fe2" returned: 0 in 0.662s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-quobyte-ff8c0745-b192-4d90-b710-cfda8ed79fe2" released by "delete_volume" :: held 1.635s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Created reservations ['1076dfac-4662-493e-bd5e-42ea28a4f5f5', '6629cc19-d1bb-4f4f-9936-119dd6e8f4ed', '043f2f2f-a77d-4b7d-a363-c05d1828ad61', 'b96378dd-edf0-4185-879d-cdc19150952c'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:56 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:57:56 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "cinder-2c4df654-ee3a-4103-963e-45799218eb19-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-2c4df654-ee3a-4103-963e-45799218eb19-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:56 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "cinder-quobyte-2c4df654-ee3a-4103-963e-45799218eb19" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.info" returned: 0 in 0.690s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:56 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.info is being set with open permissions: ugo+rw Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-quobyte-2c4df654-ee3a-4103-963e-45799218eb19" acquired by "delete_volume" :: waited 0.028s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:56 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.info Jul 08 02:57:56 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b05ffa-3e32-48f7-8820-0100fd016451]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4df654-ee3a-4103-963e-45799218eb19 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:56 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4df654-ee3a-4103-963e-45799218eb19 Jul 08 02:57:56 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:56 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.693s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:56 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:57:56 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Deleted volume successfully. Jul 08 02:57:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7acbaa81-826d-4251-a357-f7fe450a5806 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-ff8c0745-b192-4d90-b710-cfda8ed79fe2-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:57 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.info" returned: 0 in 0.686s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.628s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:57 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] Creating offline snapshot 954161cd-8a70-4329-a99b-34514489c9be of volume e5dde875-c053-4627-9979-1adc9626fec2 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:57:57 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[57024af1-b11c-4ceb-9c6b-365e206fb8ce]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:57 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-6d5f3872-6006-4ca8-84c6-feb5bf66d8fa tempest-VolumeDependencyTests-1682053107 None] Create snapshot completed successfully Jul 08 02:57:57 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2 Jul 08 02:57:57 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:57 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4df654-ee3a-4103-963e-45799218eb19" returned: 0 in 0.830s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4df654-ee3a-4103-963e-45799218eb19 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:57 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4df654-ee3a-4103-963e-45799218eb19 Jul 08 02:57:57 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:58 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2c4df654-ee3a-4103-963e-45799218eb19" returned: 0 in 0.640s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:58 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-quobyte-2c4df654-ee3a-4103-963e-45799218eb19" released by "delete_volume" :: held 1.524s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2" returned: 0 in 0.787s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:58 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be 1G Jul 08 02:57:58 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Created reservations ['70d3e41e-1480-41a1-b40d-4435046e9e82', '9a263df5-5ce6-47d4-933e-9c2c7f7f05c6', '26662077-f789-4fe0-8609-bdf45e690be7', 'bdcc08e0-bb50-4525-9777-a144d9d82ede'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:58 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:57:58 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "cinder-761d826b-2ae6-48a9-bac3-a9ac634d2578-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-761d826b-2ae6-48a9-bac3-a9ac634d2578-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "cinder-quobyte-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-quobyte-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "cinder-quobyte-761d826b-2ae6-48a9-bac3-a9ac634d2578" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-quobyte-761d826b-2ae6-48a9-bac3-a9ac634d2578" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Deleting offline snapshot 761d826b-2ae6-48a9-bac3-a9ac634d2578 of volume b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] snapshot_file for this snap is: volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ba4885-25c8-453d-943d-71a60e6c23ae]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Flow 'volume_create_manager' (0de982df-cf48-4b62-814e-a8ceb722714b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a05a2b-6bd9-4be3-9d4f-e188ace049cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:58 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.748s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a05a2b-6bd9-4be3-9d4f-e188ace049cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-430216902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2600d98d-0add-486a-85a5-0f5fcea6d7ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6088288adc134744bbee008b12ab5248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=21e5c640-29ab-4010-8d08-0d5f83af8840,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:59Z,use_quota=True,user_id='90022f542cc741068a1a866d504ba336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d488629-3bc8-4936-8f8d-eb68219c8eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d488629-3bc8-4936-8f8d-eb68219c8eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30228ab-902c-4e79-a888-0d2985ee2e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30228ab-902c-4e79-a888-0d2985ee2e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2600d98d-0add-486a-85a5-0f5fcea6d7ff', 'volume_name': 'volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff', 'volume_size': 1, 'snapshot_id': '21e5c640-29ab-4010-8d08-0d5f83af8840'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde0ed7a-7520-41ab-852c-9fd3eb70ee14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde0ed7a-7520-41ab-852c-9fd3eb70ee14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:57:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e05160-677f-413b-9533-1e9f0bb5fe4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:57:59 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Volume 2600d98d-0add-486a-85a5-0f5fcea6d7ff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff', 'volume_size': 1, 'snapshot_id': '21e5c640-29ab-4010-8d08-0d5f83af8840'} Jul 08 02:57:59 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Deleted volume successfully. Jul 08 02:57:59 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578 Jul 08 02:57:59 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:57:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c9c75c21-97af-498a-b11f-a90dbd16b681 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-2c4df654-ee3a-4103-963e-45799218eb19-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:57:59 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be 1G" returned: 0 in 0.969s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5dde875-c053-4627-9979-1adc9626fec2 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:59 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5dde875-c053-4627-9979-1adc9626fec2 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be Jul 08 02:57:59 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:59 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578" returned: 0 in 0.838s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:57:59 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cd1e3e-1af2-40d1-b63c-832cc80a93fc]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:57:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:59 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 08 02:57:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5dde875-c053-4627-9979-1adc9626fec2 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be" returned: 0 in 0.725s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:57:59 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be is being set with open permissions: ugo+rw Jul 08 02:57:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:57:59 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be Jul 08 02:57:59 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:57:59 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 Jul 08 02:57:59 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:00 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be" returned: 0 in 0.659s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:00 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:00 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.info Jul 08 02:58:00 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840" returned: 0 in 0.782s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:00 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578 Jul 08 02:58:00 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:01 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.info" returned: 0 in 0.667s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:01 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.info is being set with open permissions: ugo+rw Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:01 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.info Jul 08 02:58:01 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:01 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578" returned: 0 in 0.814s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:01 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578 Jul 08 02:58:01 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:01 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.info" returned: 0 in 0.654s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.558s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.372s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-717398957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59bf3ba-f869-46c6-9f34-562e63be6954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c7ace07aed4fc39114ff15983dee58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:53Z,use_quota=True,user_id='57b2a8790f584b22af3ed5c4c36e108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Creating volume e59bf3ba-f869-46c6-9f34-562e63be6954 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:58:01 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e59bf3ba-f869-46c6-9f34-562e63be6954 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:01 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e59bf3ba-f869-46c6-9f34-562e63be6954 1073741824 Jul 08 02:58:01 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:01 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-4b2341b3-1427-43d9-8bbc-b1caf3007b03 tempest-ProjectReaderTests-1467205220 None] Create snapshot completed successfully Jul 08 02:58:01 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840.761d826b-2ae6-48a9-bac3-a9ac634d2578" returned: 0 in 0.672s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-quobyte-761d826b-2ae6-48a9-bac3-a9ac634d2578" released by "_delete_snapshot" :: held 3.233s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-quobyte-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840" released by "delete_snapshot" :: held 3.264s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-954161cd-8a70-4329-a99b-34514489c9be-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Lock "cinder-954161cd-8a70-4329-a99b-34514489c9be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-quobyte-e5dde875-c053-4627-9979-1adc9626fec2" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Created reservations ['6044a0d6-df9e-4341-a44b-21c3a7804693', '88c393ae-9fb9-43b3-8caf-7e9875738e56', '499cf76c-d63a-42a6-b739-0fb6e3396171', '43b43f9c-d0d2-4f5b-8b17-26293477534d'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-e5dde875-c053-4627-9979-1adc9626fec2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-quobyte-954161cd-8a70-4329-a99b-34514489c9be" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-954161cd-8a70-4329-a99b-34514489c9be" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Deleting offline snapshot 954161cd-8a70-4329-a99b-34514489c9be of volume e5dde875-c053-4627-9979-1adc9626fec2 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] snapshot_file for this snap is: volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[2939e852-3c5f-405c-96a6-42382ad7d821]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:02 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Delete snapshot completed successfully. Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-93569abc-7780-4c31-848f-cb0f17003924 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-761d826b-2ae6-48a9-bac3-a9ac634d2578-delete_snapshot" released by "delete_snapshot" :: held 3.502s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:02 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be Jul 08 02:58:02 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:02 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e59bf3ba-f869-46c6-9f34-562e63be6954 1073741824" returned: 0 in 0.869s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e59bf3ba-f869-46c6-9f34-562e63be6954 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:02 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e59bf3ba-f869-46c6-9f34-562e63be6954 Jul 08 02:58:02 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "cinder-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "cinder-quobyte-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-quobyte-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ad9979-2a22-4c51-a85a-9425595a818b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:03 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be" returned: 0 in 0.898s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5dde875-c053-4627-9979-1adc9626fec2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ed22a8-7ad7-4f53-b287-f68e59d9f740]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:03 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 Jul 08 02:58:03 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:03 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2 Jul 08 02:58:03 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:03 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e59bf3ba-f869-46c6-9f34-562e63be6954" returned: 0 in 0.733s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.612s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1301356827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5a7fd5-770b-40aa-90dc-8ff9b7632375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c7ace07aed4fc39114ff15983dee58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:54Z,use_quota=True,user_id='57b2a8790f584b22af3ed5c4c36e108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Creating volume bc5a7fd5-770b-40aa-90dc-8ff9b7632375 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:58:03 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bc5a7fd5-770b-40aa-90dc-8ff9b7632375 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1997fb3c-4afa-4a1c-8467-2c8e62ddcc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e59bf3ba-f869-46c6-9f34-562e63be6954', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:03 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bc5a7fd5-770b-40aa-90dc-8ff9b7632375 1073741824 Jul 08 02:58:03 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0a1909-e2ee-4b48-9a6a-37529284c6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:03 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume volume-e59bf3ba-f869-46c6-9f34-562e63be6954 (e59bf3ba-f869-46c6-9f34-562e63be6954): created successfully Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0a1909-e2ee-4b48-9a6a-37529284c6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Flow 'volume_create_manager' (751a9261-5d62-40e0-9637-a3f8ca9cba0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:03 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b6546d88-4631-495b-8765-3ff148d1c2a8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Created volume successfully. Jul 08 02:58:03 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840" returned: 0 in 0.808s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:03 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840 Jul 08 02:58:03 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:03 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2" returned: 0 in 0.827s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:03 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be Jul 08 02:58:03 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:04 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bc5a7fd5-770b-40aa-90dc-8ff9b7632375 1073741824" returned: 0 in 0.905s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bc5a7fd5-770b-40aa-90dc-8ff9b7632375 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:04 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bc5a7fd5-770b-40aa-90dc-8ff9b7632375 Jul 08 02:58:04 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:04 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840" returned: 0 in 0.710s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-quobyte-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840" released by "delete_volume" :: held 1.597s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:04 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Created reservations ['a41c7bd9-ca81-48b8-9445-acc6a020e540', '466d3dab-d4f8-491e-9522-94881781df17', '1c453c73-af9a-4d1c-ac0d-0ffa2ea1d1a2', '8927eb43-bfa5-484e-b3ef-d20e20e605cb'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:04 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:58:04 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:04 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be" returned: 0 in 0.864s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:04 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be Jul 08 02:58:04 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:05 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bc5a7fd5-770b-40aa-90dc-8ff9b7632375" returned: 0 in 0.698s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.723s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-357219121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89674035-c0d6-41e2-8aef-81babda193e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c7ace07aed4fc39114ff15983dee58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:54Z,use_quota=True,user_id='57b2a8790f584b22af3ed5c4c36e108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Creating volume 89674035-c0d6-41e2-8aef-81babda193e0 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:58:05 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89674035-c0d6-41e2-8aef-81babda193e0 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121df109-376c-4f6c-aede-f5350d7a4f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc5a7fd5-770b-40aa-90dc-8ff9b7632375', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:05 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89674035-c0d6-41e2-8aef-81babda193e0 1073741824 Jul 08 02:58:05 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9bfc4a-e0c4-4bfe-a374-7713d57ab330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:05 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume volume-bc5a7fd5-770b-40aa-90dc-8ff9b7632375 (bc5a7fd5-770b-40aa-90dc-8ff9b7632375): created successfully Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9bfc4a-e0c4-4bfe-a374-7713d57ab330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Flow 'volume_create_manager' (833f2931-e0cf-487b-bedd-2bca11a948de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:05 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b8be36a0-c4be-4ab1-9abb-895807cf98ab tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Created volume successfully. Jul 08 02:58:05 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.726s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:58:05 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Deleted volume successfully. Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-816646a3-5ae5-43c0-be97-e9e69c0207a7 tempest-CreateVolumesFromSnapshotTest-2019968664 None] Lock "cinder-b8da5f4e-92a2-4a09-9ba6-c5a5196c7840-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:05 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2.954161cd-8a70-4329-a99b-34514489c9be" returned: 0 in 0.746s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-954161cd-8a70-4329-a99b-34514489c9be" released by "_delete_snapshot" :: held 3.450s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-e5dde875-c053-4627-9979-1adc9626fec2" released by "delete_snapshot" :: held 3.478s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Created reservations ['8f018096-45c8-42bc-959e-73568d019613', '8781b70f-0ccc-4366-bdac-a39f9435c959', 'aa0dffca-7b36-47d4-8a55-b83626c4215f', 'e0400ed1-4323-4623-a8fa-d8370865bfd6'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:05 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Delete snapshot completed successfully. Jul 08 02:58:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1d690f9d-4dde-49df-8884-bd4fd01bc5da tempest-ProjectReaderTests-1467205220 None] Lock "cinder-954161cd-8a70-4329-a99b-34514489c9be-delete_snapshot" released by "delete_snapshot" :: held 3.660s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:06 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89674035-c0d6-41e2-8aef-81babda193e0 1073741824" returned: 0 in 1.022s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89674035-c0d6-41e2-8aef-81babda193e0 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:06 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89674035-c0d6-41e2-8aef-81babda193e0 Jul 08 02:58:06 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-e5dde875-c053-4627-9979-1adc9626fec2-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-e5dde875-c053-4627-9979-1adc9626fec2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-quobyte-e5dde875-c053-4627-9979-1adc9626fec2" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-e5dde875-c053-4627-9979-1adc9626fec2" acquired by "delete_volume" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e220669-a799-4382-990d-e8cb9b63d183]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:06 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2 Jul 08 02:58:06 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:06 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89674035-c0d6-41e2-8aef-81babda193e0" returned: 0 in 0.763s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.181s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-465958455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d31d057-064a-49e4-b3c0-fbad81708e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c7ace07aed4fc39114ff15983dee58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:55Z,use_quota=True,user_id='57b2a8790f584b22af3ed5c4c36e108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Creating volume 7d31d057-064a-49e4-b3c0-fbad81708e41 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:58:06 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:58:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7d31d057-064a-49e4-b3c0-fbad81708e41 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24e1db9-67b2-4661-971e-559afb09dae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89674035-c0d6-41e2-8aef-81babda193e0', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:07 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7d31d057-064a-49e4-b3c0-fbad81708e41 1073741824 Jul 08 02:58:07 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff91525-4e74-412c-9452-83288fad4c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:07 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume volume-89674035-c0d6-41e2-8aef-81babda193e0 (89674035-c0d6-41e2-8aef-81babda193e0): created successfully Jul 08 02:58:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff91525-4e74-412c-9452-83288fad4c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:07 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Flow 'volume_create_manager' (195d5187-8e2b-4794-8c04-1e8da6c37382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:07 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f923fc5c-a95a-4198-9da9-e9376c2e234f tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Created volume successfully. Jul 08 02:58:07 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2" returned: 0 in 0.854s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:07 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2 Jul 08 02:58:07 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:08 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7d31d057-064a-49e4-b3c0-fbad81708e41 1073741824" returned: 0 in 1.051s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:08 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e5dde875-c053-4627-9979-1adc9626fec2" returned: 0 in 0.666s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-e5dde875-c053-4627-9979-1adc9626fec2" released by "delete_volume" :: held 1.610s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7d31d057-064a-49e4-b3c0-fbad81708e41 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:08 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7d31d057-064a-49e4-b3c0-fbad81708e41 Jul 08 02:58:08 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Created reservations ['e383a63d-c7c3-4ad2-b584-43688bf85294', '52708805-5160-4a31-925e-231c5481f312', 'e9f7501e-2b2d-476e-a6c0-1b01cbc38cec', '5966939d-592e-4df0-b638-cb4dba202ec8'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:08 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:58:08 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:08 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7d31d057-064a-49e4-b3c0-fbad81708e41" returned: 0 in 0.763s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.761s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-60332889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6316f767-4ae0-491d-b7c2-0202d8a85bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c7ace07aed4fc39114ff15983dee58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:57:55Z,use_quota=True,user_id='57b2a8790f584b22af3ed5c4c36e108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Creating volume 6316f767-4ae0-491d-b7c2-0202d8a85bdf {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:58:08 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6316f767-4ae0-491d-b7c2-0202d8a85bdf 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:08 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.679s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e78c64-459f-4ac0-b811-f57195bf8c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d31d057-064a-49e4-b3c0-fbad81708e41', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc13b14-842e-47bb-8c62-41cde4476a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:08 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Deleted volume successfully. Jul 08 02:58:08 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6316f767-4ae0-491d-b7c2-0202d8a85bdf 1073741824 Jul 08 02:58:08 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:08 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume volume-7d31d057-064a-49e4-b3c0-fbad81708e41 (7d31d057-064a-49e4-b3c0-fbad81708e41): created successfully Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc13b14-842e-47bb-8c62-41cde4476a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Flow 'volume_create_manager' (9322f429-c48e-40ec-9f93-e3d321b1dcb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:09 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-45b19b52-fb80-42b4-bc65-afe566b48594 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-e5dde875-c053-4627-9979-1adc9626fec2-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:09 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-22139ae8-b351-4903-8f92-728aaebd0833 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Created volume successfully. Jul 08 02:58:09 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:58:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Flow 'volume_create_manager' (b907e7b4-ad5f-4fa1-8708-001ec866a71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb3ba66-352e-439f-b4ca-eb9bbc975f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb3ba66-352e-439f-b4ca-eb9bbc975f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1961413897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b855212f-81e3-4230-92f9-bb580c5d1194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98c1439b30f40659ec191e26a8cf57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:58:09Z,use_quota=True,user_id='90715228d23e42dd81715344bc0d64e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779e3bd4-8338-4381-acfd-0d811128af9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779e3bd4-8338-4381-acfd-0d811128af9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83be83a9-157e-42c9-bcbe-854c60718d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83be83a9-157e-42c9-bcbe-854c60718d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b855212f-81e3-4230-92f9-bb580c5d1194', 'volume_name': 'volume-b855212f-81e3-4230-92f9-bb580c5d1194', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13fc870f-2af7-4f40-af87-1ee05f83aae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13fc870f-2af7-4f40-af87-1ee05f83aae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c86703b-af6b-4327-b632-07797891955c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:09 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Volume b855212f-81e3-4230-92f9-bb580c5d1194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b855212f-81e3-4230-92f9-bb580c5d1194', 'volume_size': 1} Jul 08 02:58:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:09 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6316f767-4ae0-491d-b7c2-0202d8a85bdf 1073741824" returned: 0 in 0.947s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6316f767-4ae0-491d-b7c2-0202d8a85bdf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:09 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6316f767-4ae0-491d-b7c2-0202d8a85bdf Jul 08 02:58:09 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:10 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6316f767-4ae0-491d-b7c2-0202d8a85bdf" returned: 0 in 0.667s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 11.537s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "cinder-quobyte-21e5c640-29ab-4010-8d08-0d5f83af8840-2600d98d-0add-486a-85a5-0f5fcea6d7ff" by "_create_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62e330a-070d-46cb-990b-65a8bf60e83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6316f767-4ae0-491d-b7c2-0202d8a85bdf', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734f38b5-bcae-4dbb-b6f5-51210e580b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-quobyte-21e5c640-29ab-4010-8d08-0d5f83af8840-2600d98d-0add-486a-85a5-0f5fcea6d7ff" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Creating volume 2600d98d-0add-486a-85a5-0f5fcea6d7ff from snapshot 21e5c640-29ab-4010-8d08-0d5f83af8840 {{(pid=87238) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "cinder-quobyte-2600d98d-0add-486a-85a5-0f5fcea6d7ff" by "_copy_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:10 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Volume volume-6316f767-4ae0-491d-b7c2-0202d8a85bdf (6316f767-4ae0-491d-b7c2-0202d8a85bdf): created successfully Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734f38b5-bcae-4dbb-b6f5-51210e580b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Flow 'volume_create_manager' (de10fbab-11f4-43d5-b272-c6e0081d8bf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-quobyte-2600d98d-0add-486a-85a5-0f5fcea6d7ff" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] snapshot: 21e5c640-29ab-4010-8d08-0d5f83af8840, volume: 2600d98d-0add-486a-85a5-0f5fcea6d7ff, {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 02:58:10 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-cba1b0c4-ffe2-44e7-80e6-320c7d346cd1 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Created volume successfully. Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fc7656-799f-4009-8987-0f4c04839879]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:10 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 Jul 08 02:58:10 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Flow 'volume_create_manager' (0f719433-0529-45ab-b6c4-0b7f7fb27733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f60f836-7cee-443b-8731-6efa1819f3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f60f836-7cee-443b-8731-6efa1819f3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cd96fd5b6443f5bde8e0b230bcaedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:58:11Z,use_quota=True,user_id='6fabc0d5d27847258f33db8591256266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fce8d30-917e-419b-be3c-65d8b1fbabc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fce8d30-917e-419b-be3c-65d8b1fbabc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854c4c1e-7176-4be4-986b-a57143d440cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:10 devstack cinder-volume[87238]: DEBUG cinder.image.glance [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Creating Keystone auth plugin from conf {{(pid=87238) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854c4c1e-7176-4be4-986b-a57143d440cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11', 'volume_name': 'volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11', 'volume_size': 1, 'image_id': '79e02442-d149-4659-b226-7f6fcf2705a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79e02442-d149-4659-b226-7f6fcf2705a8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c06800f16597d4bdde46071aca930ff1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a8cd96fd5b6443f5bde8e0b230bcaedd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '292574d97d53a7cf263c6dc0a6847290984a72ba57cdba4f0f65fbd2e3cd664fd48c0c5d99a0dcbcb8d85404981ad27828a74ef9520da374fd1a2871aba77b48', 'id': '79e02442-d149-4659-b226-7f6fcf2705a8', 'created_at': datetime.datetime(2026, 7, 8, 0, 58, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 58, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79e02442-d149-4659-b226-7f6fcf2705a8/file', 'properties': {}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b8c35f-f4e8-40db-8046-c3b06efe5a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b8c35f-f4e8-40db-8046-c3b06efe5a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7443aee-0b56-4e56-b989-8c7e104a0488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:11 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Volume f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11', 'volume_size': 1, 'image_id': '79e02442-d149-4659-b226-7f6fcf2705a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79e02442-d149-4659-b226-7f6fcf2705a8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c06800f16597d4bdde46071aca930ff1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a8cd96fd5b6443f5bde8e0b230bcaedd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '292574d97d53a7cf263c6dc0a6847290984a72ba57cdba4f0f65fbd2e3cd664fd48c0c5d99a0dcbcb8d85404981ad27828a74ef9520da374fd1a2871aba77b48', 'id': '79e02442-d149-4659-b226-7f6fcf2705a8', 'created_at': datetime.datetime(2026, 7, 8, 0, 58, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 58, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79e02442-d149-4659-b226-7f6fcf2705a8/file', 'properties': {}}, 'image_service': } Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Trying to clone f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 from image 79e02442-d149-4659-b226-7f6fcf2705a8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/79e02442-d149-4659-b226-7f6fcf2705a8', 'metadata': {}}]). {{(pid=87238) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 02:58:11 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Image download 0.00 MB at 0.00 MB/s Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[42910450-45e5-4f60-a169-da93fbb57f9c]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "cinder-6316f767-4ae0-491d-b7c2-0202d8a85bdf-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-6316f767-4ae0-491d-b7c2-0202d8a85bdf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=141,cinder:UPDATE=195,cinder:INSERT=49,cinder:DELETE=24 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "cinder-quobyte-6316f767-4ae0-491d-b7c2-0202d8a85bdf" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:11 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD Jul 08 02:58:11 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-quobyte-6316f767-4ae0-491d-b7c2-0202d8a85bdf" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1d1330-63cb-458a-8933-e20caba51b6d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6316f767-4ae0-491d-b7c2-0202d8a85bdf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:11 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840" returned: 0 in 0.811s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Creating direct copy from snapshot {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b67402-2bf6-4e2f-ab07-3c3500058f6d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:11 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6316f767-4ae0-491d-b7c2-0202d8a85bdf Jul 08 02:58:11 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:11 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d Jul 08 02:58:11 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:12 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:12 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD Jul 08 02:58:12 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:12 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6316f767-4ae0-491d-b7c2-0202d8a85bdf" returned: 0 in 0.781s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6316f767-4ae0-491d-b7c2-0202d8a85bdf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:12 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6316f767-4ae0-491d-b7c2-0202d8a85bdf Jul 08 02:58:12 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:12 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d" returned: 0 in 0.779s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:12 devstack cinder-volume[87238]: DEBUG cinder.utils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Path /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff not found in is_blk_device check {{(pid=87238) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 02:58:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:12 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff Jul 08 02:58:12 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:12 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD" returned: 1 in 0.792s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:58:12 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Temporary image 79e02442-d149-4659-b226-7f6fcf2705a8 is fetched for user 6fabc0d5d27847258f33db8591256266. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 02:58:12 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=208,cinder:SELECT=160,cinder:DELETE=15,cinder:INSERT=54 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:58:12 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-6316f767-4ae0-491d-b7c2-0202d8a85bdf" returned: 0 in 0.692s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:12 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[31181dd0-f894-4603-a2b1-883d8508a0fe]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-quobyte-6316f767-4ae0-491d-b7c2-0202d8a85bdf" released by "delete_volume" :: held 1.527s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:13 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Created reservations ['73cb9ae1-6dff-4b24-8546-22e8ec10ad1d', '7e7aa00e-b4b9-45de-9fcb-2386648f14d1', '91e038f1-f889-4231-baf0-32cbc4639dd6', '53eb6734-0e28-4d84-8f21-69682ffd1402'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:13 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD Jul 08 02:58:13 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:13 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:58:13 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "cinder-7d31d057-064a-49e4-b3c0-fbad81708e41-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-7d31d057-064a-49e4-b3c0-fbad81708e41-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "cinder-quobyte-7d31d057-064a-49e4-b3c0-fbad81708e41" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-quobyte-7d31d057-064a-49e4-b3c0-fbad81708e41" acquired by "delete_volume" :: waited 0.069s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:14 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cae43c-11f3-4809-9824-2e6d58c3965f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7d31d057-064a-49e4-b3c0-fbad81708e41 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:14 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD" returned: 0 in 1.354s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:14 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.292s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:14 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:58:14 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Deleted volume successfully. Jul 08 02:58:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-11bf9a81-d997-41e6-8ab5-d4d170bd438a tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-6316f767-4ae0-491d-b7c2-0202d8a85bdf-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:14 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD Jul 08 02:58:14 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:14 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7d31d057-064a-49e4-b3c0-fbad81708e41 Jul 08 02:58:14 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:15 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD" returned: 1 in 1.123s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:58:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:16 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7d31d057-064a-49e4-b3c0-fbad81708e41" returned: 0 in 1.847s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7d31d057-064a-49e4-b3c0-fbad81708e41 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:16 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7d31d057-064a-49e4-b3c0-fbad81708e41 Jul 08 02:58:16 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:17 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7d31d057-064a-49e4-b3c0-fbad81708e41" returned: 0 in 1.789s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:17 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-quobyte-7d31d057-064a-49e4-b3c0-fbad81708e41" released by "delete_volume" :: held 3.772s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Created reservations ['5ca386ca-d7ae-435b-a877-b9fc8be88e3a', '81c74610-73c2-436b-b86d-360c11752bef', 'a145f953-ee51-4695-84cf-f9e1ced1efce', '773c0c5f-8946-42ca-af65-95352d7de291'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:18 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:58:18 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:18 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff" returned: 0 in 5.866s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e586d2b-38d0-4060-b869-6ab78e7aace3]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:18 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d Jul 08 02:58:18 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "cinder-89674035-c0d6-41e2-8aef-81babda193e0-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-89674035-c0d6-41e2-8aef-81babda193e0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "cinder-quobyte-89674035-c0d6-41e2-8aef-81babda193e0" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-quobyte-89674035-c0d6-41e2-8aef-81babda193e0" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[de855724-70cd-4aef-92f0-98a7315518c6]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89674035-c0d6-41e2-8aef-81babda193e0 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:18 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89674035-c0d6-41e2-8aef-81babda193e0 Jul 08 02:58:18 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:18 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.730s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:58:18 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Deleted volume successfully. Jul 08 02:58:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-06670004-b66e-4320-b94b-3a4c7bdd1342 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-7d31d057-064a-49e4-b3c0-fbad81708e41-delete_volume" released by "delete_volume" :: held 5.026s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:19 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d" returned: 0 in 1.049s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:58:19 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Converted 1024.00 MB image at 174.48 MB/s Jul 08 02:58:19 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff is being set with open permissions: ugo+rw Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:19 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff Jul 08 02:58:19 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:19 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89674035-c0d6-41e2-8aef-81babda193e0" returned: 0 in 0.799s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89674035-c0d6-41e2-8aef-81babda193e0 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:19 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89674035-c0d6-41e2-8aef-81babda193e0 Jul 08 02:58:19 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:19 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff" returned: 0 in 0.640s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-quobyte-2600d98d-0add-486a-85a5-0f5fcea6d7ff" released by "_copy_volume_from_snapshot" :: held 9.268s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-quobyte-21e5c640-29ab-4010-8d08-0d5f83af8840-2600d98d-0add-486a-85a5-0f5fcea6d7ff" released by "_create_volume_from_snapshot" :: held 9.326s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.367s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.626s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1961413897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b855212f-81e3-4230-92f9-bb580c5d1194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98c1439b30f40659ec191e26a8cf57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:58:09Z,use_quota=True,user_id='90715228d23e42dd81715344bc0d64e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Creating volume b855212f-81e3-4230-92f9-bb580c5d1194 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:58:19 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:19 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-89674035-c0d6-41e2-8aef-81babda193e0" returned: 0 in 0.649s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:19 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194 1073741824 Jul 08 02:58:19 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-quobyte-89674035-c0d6-41e2-8aef-81babda193e0" released by "delete_volume" :: held 1.519s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e05160-677f-413b-9533-1e9f0bb5fe4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff', 'volume_size': 1, 'snapshot_id': '21e5c640-29ab-4010-8d08-0d5f83af8840'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af039db6-303c-42fc-b631-c9466497122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:20 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Volume volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff (2600d98d-0add-486a-85a5-0f5fcea6d7ff): created successfully Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af039db6-303c-42fc-b631-c9466497122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Flow 'volume_create_manager' (0de982df-cf48-4b62-814e-a8ceb722714b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Created reservations ['70354d3b-6c9e-4571-8381-fc57c6f7b4a9', '06ce4d7a-4daa-472c-81ae-762f9e14bc33', '8a9f3020-8f81-4df9-87aa-52414b98b659', 'dd6606e0-3777-4826-a142-85ef6be2dccb'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:20 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5257024d-70ea-4da6-881d-4a3978b56f25 tempest-VolumeDependencyTests-1682053107 None] Created volume successfully. Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:20 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:58:20 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "cinder-bc5a7fd5-770b-40aa-90dc-8ff9b7632375-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-bc5a7fd5-770b-40aa-90dc-8ff9b7632375-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "cinder-quobyte-bc5a7fd5-770b-40aa-90dc-8ff9b7632375" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-quobyte-bc5a7fd5-770b-40aa-90dc-8ff9b7632375" acquired by "delete_volume" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[109fe866-b3d1-4c2a-a705-90490389efa3]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bc5a7fd5-770b-40aa-90dc-8ff9b7632375 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "cinder-21e5c640-29ab-4010-8d08-0d5f83af8840-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-21e5c640-29ab-4010-8d08-0d5f83af8840-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "cinder-quobyte-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-quobyte-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "cinder-quobyte-21e5c640-29ab-4010-8d08-0d5f83af8840" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:20 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.716s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:58:20 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Deleted volume successfully. Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-quobyte-21e5c640-29ab-4010-8d08-0d5f83af8840" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Deleting offline snapshot 21e5c640-29ab-4010-8d08-0d5f83af8840 of volume 112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] snapshot_file for this snap is: volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f29862-9083-4f16-8ade-0cfc4f5cb4e8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:20 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bc5a7fd5-770b-40aa-90dc-8ff9b7632375 Jul 08 02:58:20 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-de8ec2d4-9433-499e-a15f-3b18f6932557 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-89674035-c0d6-41e2-8aef-81babda193e0-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:21 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194 1073741824" returned: 0 in 1.067s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:21 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 Jul 08 02:58:21 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:21 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194 Jul 08 02:58:21 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:21 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bc5a7fd5-770b-40aa-90dc-8ff9b7632375" returned: 0 in 0.839s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bc5a7fd5-770b-40aa-90dc-8ff9b7632375 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:21 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bc5a7fd5-770b-40aa-90dc-8ff9b7632375 Jul 08 02:58:21 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:21 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194" returned: 0 in 0.688s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.263s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cd96fd5b6443f5bde8e0b230bcaedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:58:11Z,use_quota=True,user_id='6fabc0d5d27847258f33db8591256266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Creating volume f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:58:21 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:21 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840" returned: 0 in 0.852s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:58:21 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 1073741824 Jul 08 02:58:21 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[9999d61e-6d90-4e47-875b-19ebc0163a0c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c86703b-af6b-4327-b632-07797891955c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b855212f-81e3-4230-92f9-bb580c5d1194', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b29aa39-6cf4-4d6c-b20a-bee1ae84d70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:21 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Volume volume-b855212f-81e3-4230-92f9-bb580c5d1194 (b855212f-81e3-4230-92f9-bb580c5d1194): created successfully Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b29aa39-6cf4-4d6c-b20a-bee1ae84d70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:21 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Flow 'volume_create_manager' (b907e7b4-ad5f-4fa1-8708-001ec866a71a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:21 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c3e878be-c69f-4d6b-a3b3-33965d1fd3a2 tempest-ProjectReaderTests-1467205220 None] Created volume successfully. Jul 08 02:58:21 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d Jul 08 02:58:21 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:22 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bc5a7fd5-770b-40aa-90dc-8ff9b7632375" returned: 0 in 0.694s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:22 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-quobyte-bc5a7fd5-770b-40aa-90dc-8ff9b7632375" released by "delete_volume" :: held 1.591s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:22 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Created reservations ['414cd475-bb76-4790-8e41-603268be51fe', 'ffddc351-6ccb-4668-9a30-336a72012b8b', '8ab07a5f-4f36-4ab6-9098-ff400df378b3', '463f51b9-80b6-427e-896a-c12dad06cb68'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:22 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:58:22 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:22 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d" returned: 0 in 0.887s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:22 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 Jul 08 02:58:22 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:22 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 1073741824" returned: 0 in 1.024s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:22 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 Jul 08 02:58:22 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:22 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "cinder-e59bf3ba-f869-46c6-9f34-562e63be6954-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-e59bf3ba-f869-46c6-9f34-562e63be6954-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "cinder-quobyte-e59bf3ba-f869-46c6-9f34-562e63be6954" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-quobyte-e59bf3ba-f869-46c6-9f34-562e63be6954" acquired by "delete_volume" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a7474d-a0a5-42b4-a4fe-3d20a657a2aa]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e59bf3ba-f869-46c6-9f34-562e63be6954 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:23 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e59bf3ba-f869-46c6-9f34-562e63be6954 Jul 08 02:58:23 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:23 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.757s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:58:23 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Deleted volume successfully. Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-407ff58c-e1a4-4e5a-abcd-782e21e729d8 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-bc5a7fd5-770b-40aa-90dc-8ff9b7632375-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:23 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840" returned: 0 in 0.867s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:23 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11" returned: 0 in 0.818s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.152s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:23 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840 Jul 08 02:58:23 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] Creating offline snapshot 4d72ede6-2131-4613-8c3c-fe21b69b44a4 of volume b855212f-81e3-4230-92f9-bb580c5d1194 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Attempting download of 79e02442-d149-4659-b226-7f6fcf2705a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/79e02442-d149-4659-b226-7f6fcf2705a8', 'metadata': {}}])) to volume f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30a4f21-f4d7-47ce-bffc-6ef5a190b408]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe7b0aa-b871-4711-bc4e-478f47d82615]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79e02442-d149-4659-b226-7f6fcf2705a8__0xfsdsf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:23 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194 Jul 08 02:58:23 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:23 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79e02442-d149-4659-b226-7f6fcf2705a8__0xfsdsf Jul 08 02:58:23 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:24 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e59bf3ba-f869-46c6-9f34-562e63be6954" returned: 0 in 0.914s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e59bf3ba-f869-46c6-9f34-562e63be6954 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:24 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e59bf3ba-f869-46c6-9f34-562e63be6954 Jul 08 02:58:24 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:24 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d.21e5c640-29ab-4010-8d08-0d5f83af8840" returned: 0 in 0.707s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-quobyte-21e5c640-29ab-4010-8d08-0d5f83af8840" released by "_delete_snapshot" :: held 3.479s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-quobyte-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d" released by "delete_snapshot" :: held 3.509s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Created reservations ['5f2189e1-84c7-45d6-92b1-8bc8c87f7b5a', 'c6d1ec54-74e8-49af-9090-095f393c0fc7', '59e91fe3-33d4-46b1-b73b-ea05e20eacf7', 'fbfe5639-9df4-4afa-b5ab-05a2dcc98bea'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:24 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Delete snapshot completed successfully. Jul 08 02:58:24 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-50fe5798-219f-4685-bdf1-b9172de067aa tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-21e5c640-29ab-4010-8d08-0d5f83af8840-delete_snapshot" released by "delete_snapshot" :: held 3.754s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79e02442-d149-4659-b226-7f6fcf2705a8__0xfsdsf" returned: 0 in 0.855s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e02442-d149-4659-b226-7f6fcf2705a8__0xfsdsf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:24 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194" returned: 0 in 0.967s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:24 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4 1G Jul 08 02:58:24 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:24 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e02442-d149-4659-b226-7f6fcf2705a8__0xfsdsf Jul 08 02:58:24 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:24 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-e59bf3ba-f869-46c6-9f34-562e63be6954" returned: 0 in 0.698s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-quobyte-e59bf3ba-f869-46c6-9f34-562e63be6954" released by "delete_volume" :: held 1.673s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Created reservations ['8a92e8c4-bb7c-4e30-a29c-8f08745e573f', '6143d2a9-47d3-4558-b1ce-06a6d265c697', 'bc562ad5-b1b9-48fd-b1dd-238e10f47ab9', 'b550fb73-b193-48a3-ab64-47e6e9f7bfea'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:24 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:58:24 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "cinder-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "cinder-quobyte-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-quobyte-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d" acquired by "delete_volume" :: waited 0.031s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "cinder-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcda13ce-52b1-4c5c-abbf-8adb7d43e34b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "cinder-quobyte-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:25 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-quobyte-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e02442-d149-4659-b226-7f6fcf2705a8__0xfsdsf" returned: 1 in 0.860s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e02442-d149-4659-b226-7f6fcf2705a8__0xfsdsf' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a153be7b-6b49-4b57-895d-4a9c50f2d260]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[2840466e-717a-4b16-b9ed-8744497a2a02]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:25 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d Jul 08 02:58:25 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:25 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05 Jul 08 02:58:25 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:25 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD Jul 08 02:58:25 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:25 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4 1G" returned: 0 in 1.066s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b855212f-81e3-4230-92f9-bb580c5d1194 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:25 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b855212f-81e3-4230-92f9-bb580c5d1194 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4 Jul 08 02:58:25 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:25 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.980s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:58:25 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Deleted volume successfully. Jul 08 02:58:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0a19b848-d4bc-4e48-920e-db488d3d27f5 tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-e59bf3ba-f869-46c6-9f34-562e63be6954-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:26 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d" returned: 0 in 0.959s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:26 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d Jul 08 02:58:26 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:26 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD" returned: 0 in 0.917s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:26 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05" returned: 0 in 1.030s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:26 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD Jul 08 02:58:26 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:26 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b855212f-81e3-4230-92f9-bb580c5d1194 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4" returned: 0 in 0.814s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:26 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4 is being set with open permissions: ugo+rw Jul 08 02:58:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:26 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05 Jul 08 02:58:26 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:26 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4 Jul 08 02:58:26 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:26 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d" returned: 0 in 0.700s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-quobyte-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d" released by "delete_volume" :: held 1.767s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Created reservations ['a2292b1e-464d-462a-b2af-71180b10fe46', '40fdd979-bb65-4fe6-b27e-cba1521278c5', '961455a5-f7f8-4dff-9ef8-921a761f0551', 'f92df16a-6c49-4347-ad29-1f5e65cd36da'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:27 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD" returned: 1 in 0.797s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] 79e02442-d149-4659-b226-7f6fcf2705a8 was raw, converting to raw {{(pid=87238) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:27 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 Jul 08 02:58:27 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:27 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:58:27 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:27 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4" returned: 0 in 0.732s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:27 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05" returned: 0 in 0.769s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-quobyte-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05" released by "delete_volume" :: held 1.863s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:27 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.info Jul 08 02:58:27 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Created reservations ['8da849f0-f4fb-4bfe-b837-6ffaf170857b', 'e9648f9b-515d-4aa6-94cb-698bc1251b38', 'da4d030e-92d0-4d4c-93d5-c096162ff69b', '1659b5eb-50d4-4dc8-b992-0472a8f49144'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "cinder-2600d98d-0add-486a-85a5-0f5fcea6d7ff-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-2600d98d-0add-486a-85a5-0f5fcea6d7ff-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:27 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:58:27 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "cinder-quobyte-2600d98d-0add-486a-85a5-0f5fcea6d7ff" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-quobyte-2600d98d-0add-486a-85a5-0f5fcea6d7ff" acquired by "delete_volume" :: waited 0.028s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a16400-796e-481c-a799-2eb16735fdd4]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:28 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff Jul 08 02:58:28 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:28 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.info" returned: 0 in 0.856s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:28 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.info is being set with open permissions: ugo+rw Jul 08 02:58:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:28 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:28 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.info Jul 08 02:58:28 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.040s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:28 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:58:28 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Deleted volume successfully. Jul 08 02:58:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7584be05-0244-4696-907d-4b2fd3180414 tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-112e91e4-4a7b-4a5b-bb6f-08c32ea0e19d-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:28 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11" returned: 0 in 1.187s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:28 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_79e02442-d149-4659-b226-7f6fcf2705a8_as20mhzmdevstack@QuobyteHD, size 0.00 MB, duration 1.19 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:58:28 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 02:58:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:28 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 1G Jul 08 02:58:28 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:28 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 1.122s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:28 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:58:28 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Deleted volume successfully. Jul 08 02:58:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-fa02b93d-99b2-4a2e-8588-1261af691c5c tempest-CreateVolumesFromSourceVolumeTest-1912764945 None] Lock "cinder-cdcf1b4a-b726-49d2-b0e5-7ccf4f8e8d05-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:29 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.info" returned: 0 in 0.831s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.415s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:29 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-d9f60e39-0325-44f7-a7d0-37d0ede14aeb tempest-ProjectReaderTests-1467205220 None] Create snapshot completed successfully Jul 08 02:58:29 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff" returned: 0 in 1.290s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:29 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff Jul 08 02:58:29 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:29 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 1G" returned: 0 in 1.013s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a85d5e0-aa56-4de5-942d-3f842577aae6]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:29 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 Jul 08 02:58:29 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:29 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2600d98d-0add-486a-85a5-0f5fcea6d7ff" returned: 0 in 0.754s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-4d72ede6-2131-4613-8c3c-fe21b69b44a4-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-quobyte-2600d98d-0add-486a-85a5-0f5fcea6d7ff" released by "delete_volume" :: held 2.118s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-4d72ede6-2131-4613-8c3c-fe21b69b44a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-quobyte-b855212f-81e3-4230-92f9-bb580c5d1194" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-b855212f-81e3-4230-92f9-bb580c5d1194" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-quobyte-4d72ede6-2131-4613-8c3c-fe21b69b44a4" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-4d72ede6-2131-4613-8c3c-fe21b69b44a4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Deleting offline snapshot 4d72ede6-2131-4613-8c3c-fe21b69b44a4 of volume b855212f-81e3-4230-92f9-bb580c5d1194 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:58:29 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] snapshot_file for this snap is: volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8033b1-2262-4738-83d9-7c0f042f361b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Created reservations ['307f399d-66cc-401d-aa5e-aa4e598179c5', '30475767-60af-4908-b680-e8c02b9001a9', '10d26daf-4a6e-4368-b4c2-da14b9649642', 'e04835a7-361b-4a5a-9b2a-9b1054612ab6'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:30 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:58:30 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:30 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4 Jul 08 02:58:30 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:30 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11" returned: 0 in 0.905s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:30 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 Jul 08 02:58:30 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:30 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4" returned: 0 in 0.903s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b855212f-81e3-4230-92f9-bb580c5d1194(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:58:30 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.818s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[259d0552-bd8e-4b62-b4fe-77db9d1dd462]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:31 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Deleted volume successfully. Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-856a2c76-195f-4531-b28f-f8da19e9e72e tempest-VolumeDependencyTests-1682053107 None] Lock "cinder-2600d98d-0add-486a-85a5-0f5fcea6d7ff-delete_volume" released by "delete_volume" :: held 3.529s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:31 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194 Jul 08 02:58:31 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:31 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11" returned: 1 in 0.962s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Downloaded image 79e02442-d149-4659-b226-7f6fcf2705a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/79e02442-d149-4659-b226-7f6fcf2705a8', 'metadata': {}}])) to volume f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 successfully. {{(pid=87238) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Temporary image 79e02442-d149-4659-b226-7f6fcf2705a8 for user 6fabc0d5d27847258f33db8591256266 is deleted. {{(pid=87238) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG cinder.volume.volume_utils [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Marking volume f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 as bootable. {{(pid=87238) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Copying metadata from image 79e02442-d149-4659-b226-7f6fcf2705a8 to f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11. {{(pid=87238) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Creating volume glance metadata for volume f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 backed by image 79e02442-d149-4659-b226-7f6fcf2705a8 with: {'image_id': '79e02442-d149-4659-b226-7f6fcf2705a8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c06800f16597d4bdde46071aca930ff1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87238) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7443aee-0b56-4e56-b989-8c7e104a0488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11', 'volume_size': 1, 'image_id': '79e02442-d149-4659-b226-7f6fcf2705a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79e02442-d149-4659-b226-7f6fcf2705a8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c06800f16597d4bdde46071aca930ff1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a8cd96fd5b6443f5bde8e0b230bcaedd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '292574d97d53a7cf263c6dc0a6847290984a72ba57cdba4f0f65fbd2e3cd664fd48c0c5d99a0dcbcb8d85404981ad27828a74ef9520da374fd1a2871aba77b48', 'id': '79e02442-d149-4659-b226-7f6fcf2705a8', 'created_at': datetime.datetime(2026, 7, 8, 0, 58, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 58, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79e02442-d149-4659-b226-7f6fcf2705a8/file', 'properties': {}}, 'image_service': }' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331ee37c-7984-47e5-837d-52a7a160d0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:31 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Volume volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 (f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11): created successfully Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331ee37c-7984-47e5-837d-52a7a160d0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Flow 'volume_create_manager' (0f719433-0529-45ab-b6c4-0b7f7fb27733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:31 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f97d3a67-af52-417d-a1cf-1c5a86519342 tempest-VolumeImageDependencyTests-1197770683 None] Created volume successfully. Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Acquiring lock "cinder-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Lock "cinder-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Acquiring lock "cinder-quobyte-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Lock "cinder-quobyte-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c252eaa-ab4a-4403-8cad-8cc4d83bad76]: (4, 'raw') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:31 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194" returned: 0 in 1.001s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:32 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4 Jul 08 02:58:32 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:32 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 Jul 08 02:58:32 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:32 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-a15d4a68-dc87-43b6-9f58-f9c903e647cf tempest-ProjectAdminTests-2126020115 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.710319519043, 'free_capacity_gb': 1775.710319519043, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87238) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 02:58:32 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11" returned: 0 in 0.903s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:32 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4" returned: 0 in 0.887s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:32 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4 Jul 08 02:58:32 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:33 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 Jul 08 02:58:33 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:33 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194.4d72ede6-2131-4613-8c3c-fe21b69b44a4" returned: 0 in 0.852s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-4d72ede6-2131-4613-8c3c-fe21b69b44a4" released by "_delete_snapshot" :: held 3.797s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-b855212f-81e3-4230-92f9-bb580c5d1194" released by "delete_snapshot" :: held 3.828s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:33 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11" returned: 1 in 0.993s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11' failed. Not Retrying. {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:58:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:33 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11 Jul 08 02:58:33 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:33 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Created reservations ['758ea8ff-ecb6-403f-97b1-3a6899651cb8', '0b043e38-208f-4ac3-a4cb-d93aab2e0c27', '0f06d2c4-0784-4bc0-b4a8-8f37a9193caf', '73e0f184-effb-4be1-82c8-893187292de4'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:33 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Delete snapshot completed successfully. Jul 08 02:58:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-d9f01931-35e1-4ce8-97ee-83d9ddb62eb3 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-4d72ede6-2131-4613-8c3c-fe21b69b44a4-delete_snapshot" released by "delete_snapshot" :: held 4.077s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-b855212f-81e3-4230-92f9-bb580c5d1194-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-b855212f-81e3-4230-92f9-bb580c5d1194-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-quobyte-b855212f-81e3-4230-92f9-bb580c5d1194" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-b855212f-81e3-4230-92f9-bb580c5d1194" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:34 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cd866b-c2fb-4863-ab1c-5faa17ac2aeb]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:34 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194 Jul 08 02:58:34 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:34 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11" returned: 0 in 0.874s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:34 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Lock "cinder-quobyte-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11" released by "delete_volume" :: held 2.867s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:34 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Created reservations ['cbeb4e10-b99f-4a67-b12c-605ca681af77', 'baf326a3-81e7-454a-8a46-4ca2c8fff583', '92c5ce72-4780-4b3a-9cdb-99621303f674', 'dd37834b-3fe1-40ae-8438-b94db7ad9e66'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:34 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:34 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:34 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:58:34 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:35 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194" returned: 0 in 1.149s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:35 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194 Jul 08 02:58:35 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:35 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.848s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:35 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:58:35 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Deleted volume successfully. Jul 08 02:58:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0e3daed3-6a84-44de-a6bc-e08f922845f1 tempest-VolumeImageDependencyTests-1197770683 None] Lock "cinder-f7b9efa6-e2be-4a1c-8f9b-96ad8a027f11-delete_volume" released by "delete_volume" :: held 4.004s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:36 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-b855212f-81e3-4230-92f9-bb580c5d1194" returned: 0 in 0.765s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-b855212f-81e3-4230-92f9-bb580c5d1194" released by "delete_volume" :: held 2.007s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:36 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Created reservations ['2d1ea418-6437-43fb-bd7d-f457d189de96', '18f62bae-eba5-4937-90bb-e93b6ed39398', '92d8be15-34a9-48fe-b4d9-b6249418c7e8', '6359ffcd-4fe1-4605-b3d3-fd43bbec730e'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:36 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:36 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:36 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:58:36 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Flow 'volume_create_manager' (71446958-c392-47be-8687-ddc24a4c87da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfd54dc-d165-4d7a-bb3c-c68f33d2c936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfd54dc-d165-4d7a-bb3c-c68f33d2c936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1349221654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1b911f-a884-4518-9697-3951941658bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98c1439b30f40659ec191e26a8cf57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:58:37Z,use_quota=True,user_id='90715228d23e42dd81715344bc0d64e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c10f4b-4d89-40be-880e-1d26f853e454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c10f4b-4d89-40be-880e-1d26f853e454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833014ca-9a3c-4533-bb4c-543c3a4082a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833014ca-9a3c-4533-bb4c-543c3a4082a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd1b911f-a884-4518-9697-3951941658bc', 'volume_name': 'volume-bd1b911f-a884-4518-9697-3951941658bc', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec82892-59b2-47b3-9616-db089c58cb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec82892-59b2-47b3-9616-db089c58cb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfe6f06-576d-46a0-bb06-d1596b8e0da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:37 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Volume bd1b911f-a884-4518-9697-3951941658bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd1b911f-a884-4518-9697-3951941658bc', 'volume_size': 1} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1349221654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1b911f-a884-4518-9697-3951941658bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98c1439b30f40659ec191e26a8cf57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:58:37Z,use_quota=True,user_id='90715228d23e42dd81715344bc0d64e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Creating volume bd1b911f-a884-4518-9697-3951941658bc {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:58:37 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:37 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc 1073741824 Jul 08 02:58:37 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:37 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.961s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:58:37 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Deleted volume successfully. Jul 08 02:58:37 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b371e814-2430-4e83-a816-823f88a022e3 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-b855212f-81e3-4230-92f9-bb580c5d1194-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:38 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc 1073741824" returned: 0 in 0.967s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:38 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc Jul 08 02:58:38 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:39 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc" returned: 0 in 0.781s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:58:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfe6f06-576d-46a0-bb06-d1596b8e0da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd1b911f-a884-4518-9697-3951941658bc', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fff14da-bf06-4942-8bac-4b5a2e3df994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:39 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Volume volume-bd1b911f-a884-4518-9697-3951941658bc (bd1b911f-a884-4518-9697-3951941658bc): created successfully Jul 08 02:58:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fff14da-bf06-4942-8bac-4b5a2e3df994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Flow 'volume_create_manager' (71446958-c392-47be-8687-ddc24a4c87da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:39 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-d1f9a0b2-b03f-4a41-854e-e89ef6eb47d3 tempest-ProjectReaderTests-1467205220 None] Created volume successfully. Jul 08 02:58:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] Creating offline snapshot 79a3f6f5-adb5-48a3-9911-4331379c6b24 of volume bd1b911f-a884-4518-9697-3951941658bc {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:58:39 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:58:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Flow 'volume_create_manager' (24cdbd57-34ec-431f-b156-aa86bc43be1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851dfa3f-e975-4349-b4d9-a3e08e19bb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:39 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe6c816-572b-46dc-81ce-9049d04e526a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851dfa3f-e975-4349-b4d9-a3e08e19bb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610a85d5-28cd-4858-a3a4-96a89f08f9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d97af7d4e2942999983c60e05910b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:58:40Z,use_quota=True,user_id='b07c1abcc6fb45ad98c208e123e4c391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e869207f-fd46-44fc-8185-07c9e4eb5653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e869207f-fd46-44fc-8185-07c9e4eb5653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad58ad0-40c0-40fb-8b77-c6b5a0b98bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad58ad0-40c0-40fb-8b77-c6b5a0b98bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '610a85d5-28cd-4858-a3a4-96a89f08f9be', 'volume_name': 'volume-610a85d5-28cd-4858-a3a4-96a89f08f9be', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445b7eab-69fa-41dc-9785-9ed32082bdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445b7eab-69fa-41dc-9785-9ed32082bdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:40 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef3e8b6-c0fe-405e-887d-7927e61c72ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:40 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Volume 610a85d5-28cd-4858-a3a4-96a89f08f9be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-610a85d5-28cd-4858-a3a4-96a89f08f9be', 'volume_size': 1} Jul 08 02:58:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:40 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc Jul 08 02:58:40 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:40 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc" returned: 0 in 0.890s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:40 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24 1G Jul 08 02:58:40 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:41 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24 1G" returned: 0 in 0.959s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1b911f-a884-4518-9697-3951941658bc -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:41 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1b911f-a884-4518-9697-3951941658bc -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24 Jul 08 02:58:41 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:42 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1b911f-a884-4518-9697-3951941658bc -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24" returned: 0 in 0.790s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:42 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24 is being set with open permissions: ugo+rw Jul 08 02:58:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:42 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24 Jul 08 02:58:42 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:43 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24" returned: 0 in 0.688s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:43 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.info Jul 08 02:58:43 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:44 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.info" returned: 0 in 0.757s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:44 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.info is being set with open permissions: ugo+rw Jul 08 02:58:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:44 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.info Jul 08 02:58:44 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:44 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.info" returned: 0 in 0.715s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.925s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.781s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:44 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610a85d5-28cd-4858-a3a4-96a89f08f9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d97af7d4e2942999983c60e05910b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:58:40Z,use_quota=True,user_id='b07c1abcc6fb45ad98c208e123e4c391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:58:44 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Creating volume 610a85d5-28cd-4858-a3a4-96a89f08f9be {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:58:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:44 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:44 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:44 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:58:44 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:58:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-610a85d5-28cd-4858-a3a4-96a89f08f9be 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:44 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-610a85d5-28cd-4858-a3a4-96a89f08f9be 1073741824 Jul 08 02:58:44 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:44 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-cf3562b0-2e51-4a67-ba98-911106ee222e tempest-ProjectReaderTests-1467205220 None] Create snapshot completed successfully Jul 08 02:58:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-79a3f6f5-adb5-48a3-9911-4331379c6b24-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Lock "cinder-79a3f6f5-adb5-48a3-9911-4331379c6b24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-quobyte-bd1b911f-a884-4518-9697-3951941658bc" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-bd1b911f-a884-4518-9697-3951941658bc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-quobyte-79a3f6f5-adb5-48a3-9911-4331379c6b24" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-79a3f6f5-adb5-48a3-9911-4331379c6b24" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Deleting offline snapshot 79a3f6f5-adb5-48a3-9911-4331379c6b24 of volume bd1b911f-a884-4518-9697-3951941658bc {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:58:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] snapshot_file for this snap is: volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:58:45 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5c9ac9-bd02-40ce-acb2-c06f58584dfb]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:45 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24 Jul 08 02:58:45 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:45 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-610a85d5-28cd-4858-a3a4-96a89f08f9be 1073741824" returned: 0 in 0.891s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-610a85d5-28cd-4858-a3a4-96a89f08f9be {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:45 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-610a85d5-28cd-4858-a3a4-96a89f08f9be Jul 08 02:58:45 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:46 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24" returned: 0 in 0.809s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:46 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd1b911f-a884-4518-9697-3951941658bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:58:46 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[da90924d-e7a9-47f0-8f25-8b05239e485b]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:46 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc Jul 08 02:58:46 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:46 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-610a85d5-28cd-4858-a3a4-96a89f08f9be" returned: 0 in 0.703s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:46 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:58:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:46 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef3e8b6-c0fe-405e-887d-7927e61c72ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-610a85d5-28cd-4858-a3a4-96a89f08f9be', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:46 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc8b24a-3d29-4bf6-99de-eb911915d97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:46 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Volume volume-610a85d5-28cd-4858-a3a4-96a89f08f9be (610a85d5-28cd-4858-a3a4-96a89f08f9be): created successfully Jul 08 02:58:46 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc8b24a-3d29-4bf6-99de-eb911915d97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:46 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Flow 'volume_create_manager' (24cdbd57-34ec-431f-b156-aa86bc43be1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:46 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-7328c1cb-0924-4889-b3aa-832730603cae tempest-CinderUnicodeTest-1687313313 None] Created volume successfully. Jul 08 02:58:46 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc" returned: 0 in 0.822s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:46 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24 Jul 08 02:58:46 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:47 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:58:47 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:47 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24" returned: 0 in 0.827s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:47 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24 Jul 08 02:58:47 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Flow 'volume_create_manager' (bf2c1c87-0d74-4eca-8a3a-dc2e9bb17668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831625ce-6971-4b1a-bf44-aba8befd421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831625ce-6971-4b1a-bf44-aba8befd421b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:58:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1853999222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af65f0bd-8004-4207-a9b9-ab66f7dbb040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d97af7d4e2942999983c60e05910b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:58:48Z,use_quota=True,user_id='b07c1abcc6fb45ad98c208e123e4c391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a30d53d-4e66-4848-a816-4ce406fd1393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a30d53d-4e66-4848-a816-4ce406fd1393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4b94d1-07db-411c-b216-23cdb708ab93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4b94d1-07db-411c-b216-23cdb708ab93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af65f0bd-8004-4207-a9b9-ab66f7dbb040', 'volume_name': 'volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e82c3f0-0825-4808-9c5d-548f0d35ca94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e82c3f0-0825-4808-9c5d-548f0d35ca94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c72a4e7-2b20-4e58-aa52-5717476d648a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:48 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Volume af65f0bd-8004-4207-a9b9-ab66f7dbb040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040', 'volume_size': 1} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:58:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1853999222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af65f0bd-8004-4207-a9b9-ab66f7dbb040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d97af7d4e2942999983c60e05910b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:58:48Z,use_quota=True,user_id='b07c1abcc6fb45ad98c208e123e4c391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Creating volume af65f0bd-8004-4207-a9b9-ab66f7dbb040 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:58:48 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:48 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 1073741824 Jul 08 02:58:48 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:48 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.765s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:58:48 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc.79a3f6f5-adb5-48a3-9911-4331379c6b24" returned: 0 in 0.739s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-79a3f6f5-adb5-48a3-9911-4331379c6b24" released by "_delete_snapshot" :: held 3.336s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-bd1b911f-a884-4518-9697-3951941658bc" released by "delete_snapshot" :: held 3.366s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Created reservations ['59bc1067-a6ef-49f8-bab5-c745447fdac8', 'fd0e89fd-f593-4dd2-85c7-892d7fe97048', '5e83f6bb-0598-4f55-97aa-fd72822431fe', '283f62c3-8425-4598-b1b9-b537cab27e5b'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:48 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Delete snapshot completed successfully. Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-ccd35b79-af38-4298-a8c7-4f14905b19fe tempest-ProjectReaderTests-1467205220 None] Lock "cinder-79a3f6f5-adb5-48a3-9911-4331379c6b24-delete_snapshot" released by "delete_snapshot" :: held 3.527s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:48 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 1073741824" returned: 0 in 0.916s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:48 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 Jul 08 02:58:48 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-bd1b911f-a884-4518-9697-3951941658bc-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-bd1b911f-a884-4518-9697-3951941658bc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-quobyte-bd1b911f-a884-4518-9697-3951941658bc" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:49 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-bd1b911f-a884-4518-9697-3951941658bc" acquired by "delete_volume" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:49 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[3211e585-be81-4333-b359-9f67347a8531]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:49 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040" returned: 0 in 0.685s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:49 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:58:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c72a4e7-2b20-4e58-aa52-5717476d648a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ec2c2a-fe6c-4733-9c29-ee0abdd60b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:49 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc Jul 08 02:58:49 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:49 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Volume volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 (af65f0bd-8004-4207-a9b9-ab66f7dbb040): created successfully Jul 08 02:58:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ec2c2a-fe6c-4733-9c29-ee0abdd60b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:49 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Flow 'volume_create_manager' (bf2c1c87-0d74-4eca-8a3a-dc2e9bb17668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:49 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-19f7949e-10b5-4c92-a864-c6ee0039f4e5 tempest-CinderUnicodeTest-1687313313 None] Created volume successfully. Jul 08 02:58:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:50 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] Creating offline snapshot f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 of volume af65f0bd-8004-4207-a9b9-ab66f7dbb040 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:58:50 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeae6ae-fc0b-4a7d-9128-e3c6eba379e0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:50 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 Jul 08 02:58:50 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:50 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc" returned: 0 in 0.822s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:50 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc Jul 08 02:58:50 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:51 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040" returned: 0 in 0.835s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:51 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-bd1b911f-a884-4518-9697-3951941658bc" returned: 0 in 0.737s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:51 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 1G Jul 08 02:58:51 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-bd1b911f-a884-4518-9697-3951941658bc" released by "delete_volume" :: held 1.630s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:51 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Created reservations ['4a42b659-57e6-41f8-9179-62b33eb123b7', '029a6a4a-d2ff-402b-9b11-0e15e25043ab', 'dbf6f8cc-bcd4-4de5-9fb0-0e5ae8e5337b', '6284beb3-0350-4214-8b6f-139212edd1a1'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:51 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:51 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:58:51 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:52 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:52 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 1G" returned: 0 in 1.047s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.838s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:58:52 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 Jul 08 02:58:52 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:52 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Deleted volume successfully. Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f51f3a15-f7a7-4a00-bc44-3b1a2df4caa0 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-bd1b911f-a884-4518-9697-3951941658bc-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Flow 'volume_create_manager' (f5e18302-30c6-427e-b197-8c21b973b8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba211b3-7380-4cd2-bde8-a8574e2d3d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba211b3-7380-4cd2-bde8-a8574e2d3d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1955740952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15933ba6-49fa-4bf1-9cfa-a226698d3526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98c1439b30f40659ec191e26a8cf57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:58:52Z,use_quota=True,user_id='90715228d23e42dd81715344bc0d64e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0d5a4a-e9bb-4147-b23a-fb69f50ae012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0d5a4a-e9bb-4147-b23a-fb69f50ae012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418eb7af-59b5-4605-bfa5-e416c870e94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418eb7af-59b5-4605-bfa5-e416c870e94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15933ba6-49fa-4bf1-9cfa-a226698d3526', 'volume_name': 'volume-15933ba6-49fa-4bf1-9cfa-a226698d3526', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccb2c7a-3041-44c0-bb3a-1de98a553e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccb2c7a-3041-44c0-bb3a-1de98a553e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b1967d-7925-461d-89a2-8f556b0d6768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:52 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Volume 15933ba6-49fa-4bf1-9cfa-a226698d3526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15933ba6-49fa-4bf1-9cfa-a226698d3526', 'volume_size': 1} Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:52 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93" returned: 0 in 0.759s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:52 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 is being set with open permissions: ugo+rw Jul 08 02:58:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:52 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 Jul 08 02:58:52 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:53 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93" returned: 0 in 0.668s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:53 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.info Jul 08 02:58:53 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:53 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:58:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Flow 'volume_create_manager' (0840d5d9-7425-415c-8f5d-f66ecdf6a379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13316cd8-8705-47a0-a303-f7acccc62270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13316cd8-8705-47a0-a303-f7acccc62270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511134984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2458a320-d833-4f39-ba34-7b929a8aa5fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3074383b25e0404aac71a2d0c9fac458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:58:54Z,use_quota=True,user_id='f60a15290cd54d6bb40b9e7c5a957d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f94af71-221c-49f3-889e-096c3387c834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f94af71-221c-49f3-889e-096c3387c834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193b4ba6-1b62-4740-98ff-9d9416f63564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193b4ba6-1b62-4740-98ff-9d9416f63564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2458a320-d833-4f39-ba34-7b929a8aa5fc', 'volume_name': 'volume-2458a320-d833-4f39-ba34-7b929a8aa5fc', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969d337f-c649-4a50-8415-7c3a3ba5c787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969d337f-c649-4a50-8415-7c3a3ba5c787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070e39a1-dd4d-483c-8d57-8471cbd4283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:54 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Volume 2458a320-d833-4f39-ba34-7b929a8aa5fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2458a320-d833-4f39-ba34-7b929a8aa5fc', 'volume_size': 1} Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:54 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.info" returned: 0 in 0.654s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:54 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.info is being set with open permissions: ugo+rw Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:54 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.info Jul 08 02:58:54 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:54 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.info" returned: 0 in 0.642s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.708s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.568s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1955740952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15933ba6-49fa-4bf1-9cfa-a226698d3526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98c1439b30f40659ec191e26a8cf57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:58:52Z,use_quota=True,user_id='90715228d23e42dd81715344bc0d64e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Creating volume 15933ba6-49fa-4bf1-9cfa-a226698d3526 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:58:54 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:58:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:54 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 1073741824 Jul 08 02:58:54 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:54 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b5070f10-6806-4f3c-bf0a-d3f10d4b924a tempest-CinderUnicodeTest-1687313313 None] Create snapshot completed successfully Jul 08 02:58:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Acquiring lock "cinder-f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Lock "cinder-f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Acquiring lock "cinder-quobyte-af65f0bd-8004-4207-a9b9-ab66f7dbb040" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Lock "cinder-quobyte-af65f0bd-8004-4207-a9b9-ab66f7dbb040" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Acquiring lock "cinder-quobyte-f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Lock "cinder-quobyte-f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Deleting offline snapshot f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 of volume af65f0bd-8004-4207-a9b9-ab66f7dbb040 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:58:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] snapshot_file for this snap is: volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:58:55 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[223eaceb-50f2-45f4-bea1-9d726a1fb6ff]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:55 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 Jul 08 02:58:55 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:55 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 1073741824" returned: 0 in 0.830s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:55 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 Jul 08 02:58:55 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:56 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93" returned: 0 in 0.798s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfe7770-12e9-4797-bb86-bbaf8eb21071]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:56 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526" returned: 0 in 0.662s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.453s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511134984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2458a320-d833-4f39-ba34-7b929a8aa5fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3074383b25e0404aac71a2d0c9fac458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:58:54Z,use_quota=True,user_id='f60a15290cd54d6bb40b9e7c5a957d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Creating volume 2458a320-d833-4f39-ba34-7b929a8aa5fc {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:58:56 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2458a320-d833-4f39-ba34-7b929a8aa5fc 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:56 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 Jul 08 02:58:56 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b1967d-7925-461d-89a2-8f556b0d6768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15933ba6-49fa-4bf1-9cfa-a226698d3526', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:56 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2458a320-d833-4f39-ba34-7b929a8aa5fc 1073741824 Jul 08 02:58:56 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c3a1b2-9491-426f-9f76-6314281770fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:56 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Volume volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 (15933ba6-49fa-4bf1-9cfa-a226698d3526): created successfully Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c3a1b2-9491-426f-9f76-6314281770fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:56 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Flow 'volume_create_manager' (f5e18302-30c6-427e-b197-8c21b973b8a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:56 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ad568267-087e-4b0e-af23-f4d6f97ac4a4 tempest-ProjectReaderTests-1467205220 None] Created volume successfully. Jul 08 02:58:57 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040" returned: 0 in 0.753s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:57 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 Jul 08 02:58:57 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:57 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2458a320-d833-4f39-ba34-7b929a8aa5fc 1073741824" returned: 0 in 0.872s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2458a320-d833-4f39-ba34-7b929a8aa5fc {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:57 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2458a320-d833-4f39-ba34-7b929a8aa5fc Jul 08 02:58:57 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:58:57 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93" returned: 0 in 0.793s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:57 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93 Jul 08 02:58:57 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:58 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2458a320-d833-4f39-ba34-7b929a8aa5fc" returned: 0 in 0.710s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.487s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070e39a1-dd4d-483c-8d57-8471cbd4283b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2458a320-d833-4f39-ba34-7b929a8aa5fc', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a56187-e78c-40b9-8942-e7eafc2d1434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] Creating offline snapshot c8874608-bb3f-4137-a4a6-64adaa8e866b of volume 15933ba6-49fa-4bf1-9cfa-a226698d3526 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:58:58 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Volume volume-2458a320-d833-4f39-ba34-7b929a8aa5fc (2458a320-d833-4f39-ba34-7b929a8aa5fc): created successfully Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a56187-e78c-40b9-8942-e7eafc2d1434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Flow 'volume_create_manager' (0840d5d9-7425-415c-8f5d-f66ecdf6a379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a544c262-ee49-4a70-acfd-b67543553004]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:58 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-836f49ef-2f3e-4ab8-96aa-d9f98576ac89 tempest-ProjectReaderTests-1666299680 None] Created volume successfully. Jul 08 02:58:58 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 Jul 08 02:58:58 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:58 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040.f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93" returned: 0 in 0.660s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Lock "cinder-quobyte-f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93" released by "_delete_snapshot" :: held 3.121s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Lock "cinder-quobyte-af65f0bd-8004-4207-a9b9-ab66f7dbb040" released by "delete_snapshot" :: held 3.148s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Created reservations ['2e5d47c4-3a54-4f03-8256-c41ffcb1ae4b', 'd51bea1b-e44e-4477-8acd-622e5dc540ff', '10d3cac4-1744-4f87-8cfb-f8be1b259428', 'cfbb8c48-eab7-449a-9409-4ef6e23ac8f7'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:58:58 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Delete snapshot completed successfully. Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-31785881-9fe9-4e60-a36b-067a1984af50 tempest-CinderUnicodeTest-1687313313 None] Lock "cinder-f45195ac-f2f7-4bac-a7c3-5bc39c9b0b93-delete_snapshot" released by "delete_snapshot" :: held 3.286s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:58:58 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526" returned: 0 in 0.790s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:59 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b 1G Jul 08 02:58:59 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Acquiring lock "cinder-2458a320-d833-4f39-ba34-7b929a8aa5fc-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Lock "cinder-2458a320-d833-4f39-ba34-7b929a8aa5fc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Acquiring lock "cinder-quobyte-2458a320-d833-4f39-ba34-7b929a8aa5fc" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Lock "cinder-quobyte-2458a320-d833-4f39-ba34-7b929a8aa5fc" acquired by "delete_volume" :: waited 0.013s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:59 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[1550ec1b-12e5-454b-9ab6-62519f6be633]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2458a320-d833-4f39-ba34-7b929a8aa5fc {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:59 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2458a320-d833-4f39-ba34-7b929a8aa5fc Jul 08 02:58:59 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Acquiring lock "cinder-af65f0bd-8004-4207-a9b9-ab66f7dbb040-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Lock "cinder-af65f0bd-8004-4207-a9b9-ab66f7dbb040-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Acquiring lock "cinder-quobyte-af65f0bd-8004-4207-a9b9-ab66f7dbb040" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:58:59 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 08 02:58:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b 1G" returned: 0 in 0.847s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:58:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:58:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Lock "cinder-quobyte-af65f0bd-8004-4207-a9b9-ab66f7dbb040" acquired by "delete_volume" :: waited 0.031s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:58:59 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b Jul 08 02:58:59 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:58:59 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fb3918-ff72-4721-b282-bc0be7aca123]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:58:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:00 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 Jul 08 02:59:00 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:00 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2458a320-d833-4f39-ba34-7b929a8aa5fc" returned: 0 in 0.817s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2458a320-d833-4f39-ba34-7b929a8aa5fc {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:00 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2458a320-d833-4f39-ba34-7b929a8aa5fc Jul 08 02:59:00 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:00 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b" returned: 0 in 0.698s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:00 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b is being set with open permissions: ugo+rw Jul 08 02:59:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:00 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b Jul 08 02:59:00 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:00 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040" returned: 0 in 0.791s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:00 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040 Jul 08 02:59:00 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:00 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-2458a320-d833-4f39-ba34-7b929a8aa5fc" returned: 0 in 0.673s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:00 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Lock "cinder-quobyte-2458a320-d833-4f39-ba34-7b929a8aa5fc" released by "delete_volume" :: held 1.537s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:00 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Created reservations ['c1133723-6679-415f-a746-235d34f5fc8b', 'd26a6dfb-fb8d-4c65-9542-39f282743db8', 'b9468c7a-618c-4e22-97ee-b0c654b4c69f', 'e9862a87-1d5f-42c5-90a8-2042f88c65a9'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:01 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:59:01 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:01 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b" returned: 0 in 0.712s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:01 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.info Jul 08 02:59:01 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:01 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-af65f0bd-8004-4207-a9b9-ab66f7dbb040" returned: 0 in 0.717s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Lock "cinder-quobyte-af65f0bd-8004-4207-a9b9-ab66f7dbb040" released by "delete_volume" :: held 1.573s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Created reservations ['980fad5c-309e-4b42-9e3e-7dea8c0f3786', 'af613663-55ee-4430-b7ee-d27eacb21729', '85bb1a91-3a78-4ee7-9ac4-acd54d545b76', '7cefab13-896e-41e0-9be3-8a440bda6d9c'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:01 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:59:01 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:01 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.811s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:59:01 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Deleted volume successfully. Jul 08 02:59:01 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-5a263bc2-8776-417a-845c-c7294af0c3b3 tempest-ProjectReaderTests-1666299680 None] Lock "cinder-2458a320-d833-4f39-ba34-7b929a8aa5fc-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Acquiring lock "cinder-610a85d5-28cd-4858-a3a4-96a89f08f9be-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Lock "cinder-610a85d5-28cd-4858-a3a4-96a89f08f9be-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:59:02 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Flow 'volume_create_manager' (e5e936ca-49b7-4c3b-91ea-ca5cd14cf82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df6887a-6674-45e5-a2f0-32d28f42bb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.info" returned: 0 in 0.907s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:02 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.info is being set with open permissions: ugo+rw Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:02 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.info Jul 08 02:59:02 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df6887a-6674-45e5-a2f0-32d28f42bb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1117497125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba2eec0-105a-4392-b6a4-10b003456b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3074383b25e0404aac71a2d0c9fac458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:02Z,use_quota=True,user_id='f60a15290cd54d6bb40b9e7c5a957d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560b33f6-187c-4e15-bc71-441605748f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560b33f6-187c-4e15-bc71-441605748f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5854bc-4b99-474b-8630-454c879911be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5854bc-4b99-474b-8630-454c879911be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ba2eec0-105a-4392-b6a4-10b003456b64', 'volume_name': 'volume-8ba2eec0-105a-4392-b6a4-10b003456b64', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9bf7d8-7be5-4fe6-9e3c-fd1a01ecc9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9bf7d8-7be5-4fe6-9e3c-fd1a01ecc9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1902a200-a08f-49e6-a0fb-a2a0f41fab9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:02 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Volume 8ba2eec0-105a-4392-b6a4-10b003456b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ba2eec0-105a-4392-b6a4-10b003456b64', 'volume_size': 1} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Acquiring lock "cinder-quobyte-610a85d5-28cd-4858-a3a4-96a89f08f9be" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Lock "cinder-quobyte-610a85d5-28cd-4858-a3a4-96a89f08f9be" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e159b8-0cde-43e4-bdd7-d5bfa0ab5a67]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-610a85d5-28cd-4858-a3a4-96a89f08f9be {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:02 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.816s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:59:02 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Deleted volume successfully. Jul 08 02:59:02 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-610a85d5-28cd-4858-a3a4-96a89f08f9be Jul 08 02:59:02 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bcf347c8-1feb-4d73-9ea1-99a410f3a380 tempest-CinderUnicodeTest-1687313313 None] Lock "cinder-af65f0bd-8004-4207-a9b9-ab66f7dbb040-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:02 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.info" returned: 0 in 0.667s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.749s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.605s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1117497125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba2eec0-105a-4392-b6a4-10b003456b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3074383b25e0404aac71a2d0c9fac458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:02Z,use_quota=True,user_id='f60a15290cd54d6bb40b9e7c5a957d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Creating volume 8ba2eec0-105a-4392-b6a4-10b003456b64 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:59:02 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:59:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ba2eec0-105a-4392-b6a4-10b003456b64 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:02 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ba2eec0-105a-4392-b6a4-10b003456b64 1073741824 Jul 08 02:59:02 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:02 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-bc71a537-ab51-4926-bae3-673d68003cf2 tempest-ProjectReaderTests-1467205220 None] Create snapshot completed successfully Jul 08 02:59:03 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-610a85d5-28cd-4858-a3a4-96a89f08f9be" returned: 0 in 0.806s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-610a85d5-28cd-4858-a3a4-96a89f08f9be {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:03 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-610a85d5-28cd-4858-a3a4-96a89f08f9be Jul 08 02:59:03 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:03 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ba2eec0-105a-4392-b6a4-10b003456b64 1073741824" returned: 0 in 0.819s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ba2eec0-105a-4392-b6a4-10b003456b64 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:03 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ba2eec0-105a-4392-b6a4-10b003456b64 Jul 08 02:59:03 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:03 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-610a85d5-28cd-4858-a3a4-96a89f08f9be" returned: 0 in 0.689s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:03 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Lock "cinder-quobyte-610a85d5-28cd-4858-a3a4-96a89f08f9be" released by "delete_volume" :: held 1.544s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:03 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Created reservations ['7ebe896a-7a03-40d8-b369-d6fa635b11a0', 'fb33e3e7-3416-4989-85a6-462c44c451b6', '1a8ae5ce-b7e7-4e42-b2a9-621cf8f62f5d', '00c2bd8f-a2c6-4aa4-9fd8-4a75f54567c9'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:59:03 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-c8874608-bb3f-4137-a4a6-64adaa8e866b-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-c8874608-bb3f-4137-a4a6-64adaa8e866b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-quobyte-15933ba6-49fa-4bf1-9cfa-a226698d3526" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:04 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-15933ba6-49fa-4bf1-9cfa-a226698d3526" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-quobyte-c8874608-bb3f-4137-a4a6-64adaa8e866b" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:04 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-c8874608-bb3f-4137-a4a6-64adaa8e866b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Deleting offline snapshot c8874608-bb3f-4137-a4a6-64adaa8e866b of volume 15933ba6-49fa-4bf1-9cfa-a226698d3526 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] snapshot_file for this snap is: volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9524e83-4a1c-44b4-96c9-b45f3772f1a8]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:04 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b Jul 08 02:59:04 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:04 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ba2eec0-105a-4392-b6a4-10b003456b64" returned: 0 in 0.749s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1902a200-a08f-49e6-a0fb-a2a0f41fab9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ba2eec0-105a-4392-b6a4-10b003456b64', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde1d774-cbd0-4820-988d-23c55dd6378a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:04 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Volume volume-8ba2eec0-105a-4392-b6a4-10b003456b64 (8ba2eec0-105a-4392-b6a4-10b003456b64): created successfully Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde1d774-cbd0-4820-988d-23c55dd6378a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Flow 'volume_create_manager' (e5e936ca-49b7-4c3b-91ea-ca5cd14cf82f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:04 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f7107efd-f465-4347-98ac-06207a64d9d6 tempest-ProjectReaderTests-1666299680 None] Created volume successfully. Jul 08 02:59:04 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.739s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:59:04 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Deleted volume successfully. Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e2b51976-7848-423d-bb0c-b5ff901d27b5 tempest-CinderUnicodeTest-1687313313 None] Lock "cinder-610a85d5-28cd-4858-a3a4-96a89f08f9be-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:04 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b" returned: 0 in 0.900s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15933ba6-49fa-4bf1-9cfa-a226698d3526(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:59:05 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5c5a6c-4dd4-423e-ad65-d7edb63aec99]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:05 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 Jul 08 02:59:05 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Acquiring lock "cinder-8ba2eec0-105a-4392-b6a4-10b003456b64-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Lock "cinder-8ba2eec0-105a-4392-b6a4-10b003456b64-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Acquiring lock "cinder-quobyte-8ba2eec0-105a-4392-b6a4-10b003456b64" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Lock "cinder-quobyte-8ba2eec0-105a-4392-b6a4-10b003456b64" acquired by "delete_volume" :: waited 0.014s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:05 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec65e96-b920-4af8-b81c-ac1198ee1a45]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ba2eec0-105a-4392-b6a4-10b003456b64 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:05 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ba2eec0-105a-4392-b6a4-10b003456b64 Jul 08 02:59:05 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:05 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526" returned: 0 in 0.880s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:05 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b Jul 08 02:59:05 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:06 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ba2eec0-105a-4392-b6a4-10b003456b64" returned: 0 in 0.849s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ba2eec0-105a-4392-b6a4-10b003456b64 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:06 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ba2eec0-105a-4392-b6a4-10b003456b64 Jul 08 02:59:06 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:06 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b" returned: 0 in 0.810s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:06 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b Jul 08 02:59:06 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:07 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-8ba2eec0-105a-4392-b6a4-10b003456b64" returned: 0 in 0.678s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Lock "cinder-quobyte-8ba2eec0-105a-4392-b6a4-10b003456b64" released by "delete_volume" :: held 1.573s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Created reservations ['223e1176-6db9-4bb1-8991-ca995d623605', '5a2bcbe4-980b-4021-88ec-24d475f6ba1b', '0b2d74b1-1d17-4787-9694-551b58396d65', '2b1092b4-f965-443f-b36c-e1417d17a6ee'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:07 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:59:07 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:07 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526.c8874608-bb3f-4137-a4a6-64adaa8e866b" returned: 0 in 0.682s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-c8874608-bb3f-4137-a4a6-64adaa8e866b" released by "_delete_snapshot" :: held 3.398s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-15933ba6-49fa-4bf1-9cfa-a226698d3526" released by "delete_snapshot" :: held 3.429s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Created reservations ['803a9b49-346b-4b48-b311-4cb3416ecbdf', '933bd039-e600-460d-8bd6-ef878adf3ef0', '465e0aad-5e41-4552-a80b-41a3edcb95d0', 'ac3411f1-5495-46cb-8001-c3f14ef802ab'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:59:07 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Delete snapshot completed successfully. Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-872ead4b-8537-4463-be43-76d062d0ba19 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-c8874608-bb3f-4137-a4a6-64adaa8e866b-delete_snapshot" released by "delete_snapshot" :: held 3.581s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:07 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.718s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:59:07 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Deleted volume successfully. Jul 08 02:59:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-92fec802-da11-492d-98d1-a78f680cd76b tempest-ProjectReaderTests-1666299680 None] Lock "cinder-8ba2eec0-105a-4392-b6a4-10b003456b64-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-15933ba6-49fa-4bf1-9cfa-a226698d3526-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-15933ba6-49fa-4bf1-9cfa-a226698d3526-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (d198ae14-17ed-4480-87ca-4edbe4ba70e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003313fd-227e-491d-a669-738e8e26cc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003313fd-227e-491d-a669-738e8e26cc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2093921481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e10feb-75d2-4d99-bec4-41233f7f3bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:08Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e41e46-ef80-44d3-ad99-e1e2c100802d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e41e46-ef80-44d3-ad99-e1e2c100802d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e481ea5-ff57-4d0c-af77-d63ce79b470a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e481ea5-ff57-4d0c-af77-d63ce79b470a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8e10feb-75d2-4d99-bec4-41233f7f3bbf', 'volume_name': 'volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28af2a19-63a2-4fb1-926b-66d92150b481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28af2a19-63a2-4fb1-926b-66d92150b481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f7dca1-4781-4b2b-b581-0fdcffd6d0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:08 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Volume d8e10feb-75d2-4d99-bec4-41233f7f3bbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf', 'volume_size': 1} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2093921481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e10feb-75d2-4d99-bec4-41233f7f3bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:08Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Creating volume d8e10feb-75d2-4d99-bec4-41233f7f3bbf {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:59:08 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:08 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf 1073741824 Jul 08 02:59:08 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Flow 'volume_create_manager' (833503da-4509-4d09-b579-a3c1e36c0c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15371788-6cc9-4496-a5d7-78f6c9fae9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "cinder-quobyte-15933ba6-49fa-4bf1-9cfa-a226698d3526" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15371788-6cc9-4496-a5d7-78f6c9fae9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-998309369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a202ec-5191-4ffc-9341-b901a5d65943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3074383b25e0404aac71a2d0c9fac458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:08Z,use_quota=True,user_id='f60a15290cd54d6bb40b9e7c5a957d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71391237-c2e9-4188-98ec-4290b4ec4969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71391237-c2e9-4188-98ec-4290b4ec4969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686c0cfe-ef03-4e1d-9128-0c45adbbd5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686c0cfe-ef03-4e1d-9128-0c45adbbd5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6a202ec-5191-4ffc-9341-b901a5d65943', 'volume_name': 'volume-c6a202ec-5191-4ffc-9341-b901a5d65943', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8ad50c-1bd6-4006-b155-69e917a4c5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8ad50c-1bd6-4006-b155-69e917a4c5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe2244b-d1b9-4ff3-abe5-b7d2dc8ce1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:08 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Volume c6a202ec-5191-4ffc-9341-b901a5d65943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6a202ec-5191-4ffc-9341-b901a5d65943', 'volume_size': 1} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-15933ba6-49fa-4bf1-9cfa-a226698d3526" acquired by "delete_volume" :: waited 0.055s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[007ac575-c511-46aa-9862-681225007e28]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:08 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 Jul 08 02:59:08 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:09 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf 1073741824" returned: 0 in 0.870s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:09 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf Jul 08 02:59:09 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:09 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526" returned: 0 in 0.784s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:09 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526 Jul 08 02:59:09 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:09 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf" returned: 0 in 0.647s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.434s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-998309369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a202ec-5191-4ffc-9341-b901a5d65943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3074383b25e0404aac71a2d0c9fac458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:08Z,use_quota=True,user_id='f60a15290cd54d6bb40b9e7c5a957d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Creating volume c6a202ec-5191-4ffc-9341-b901a5d65943 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:59:09 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c6a202ec-5191-4ffc-9341-b901a5d65943 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:09 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15933ba6-49fa-4bf1-9cfa-a226698d3526" returned: 0 in 0.634s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:09 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c6a202ec-5191-4ffc-9341-b901a5d65943 1073741824 Jul 08 02:59:09 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f7dca1-4781-4b2b-b581-0fdcffd6d0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0986b3d8-30ea-46c4-a9ed-c5dc5b7b8f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-quobyte-15933ba6-49fa-4bf1-9cfa-a226698d3526" released by "delete_volume" :: held 1.489s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:09 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Volume volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf (d8e10feb-75d2-4d99-bec4-41233f7f3bbf): created successfully Jul 08 02:59:09 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0986b3d8-30ea-46c4-a9ed-c5dc5b7b8f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:10 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (d198ae14-17ed-4480-87ca-4edbe4ba70e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:10 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-39a44ae7-fa7b-407f-9258-edc4cd87eeba tempest-ProjectMemberTests-1616543176 None] Created volume successfully. Jul 08 02:59:10 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Created reservations ['d65b5fe8-e6d8-48cc-8ed6-d45b532fb5f0', '018108ca-2245-4e0c-981a-936e5009798b', 'c71181bd-2b5a-4fe4-8ac9-84ff779f06af', '97457952-ea88-4661-9f15-0f989eafd74c'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:59:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:10 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:10 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:59:10 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:10 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.743s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:10 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:59:10 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Deleted volume successfully. Jul 08 02:59:10 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-047135c4-08dd-4692-804b-08b27b110373 tempest-ProjectReaderTests-1467205220 None] Lock "cinder-15933ba6-49fa-4bf1-9cfa-a226698d3526-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c6a202ec-5191-4ffc-9341-b901a5d65943 1073741824" returned: 0 in 0.964s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c6a202ec-5191-4ffc-9341-b901a5d65943 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:10 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c6a202ec-5191-4ffc-9341-b901a5d65943 Jul 08 02:59:10 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:11 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c6a202ec-5191-4ffc-9341-b901a5d65943" returned: 0 in 0.713s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:59:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.142s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] Creating offline snapshot daf30570-5f09-488c-9e5d-d9a2af11b1e3 of volume d8e10feb-75d2-4d99-bec4-41233f7f3bbf {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:59:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe2244b-d1b9-4ff3-abe5-b7d2dc8ce1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6a202ec-5191-4ffc-9341-b901a5d65943', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b42f4547-a740-4cb1-9b03-8dfd94aa7431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:11 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[9543fe15-f40f-4051-938b-369a0bf6c4ba]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:11 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Volume volume-c6a202ec-5191-4ffc-9341-b901a5d65943 (c6a202ec-5191-4ffc-9341-b901a5d65943): created successfully Jul 08 02:59:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b42f4547-a740-4cb1-9b03-8dfd94aa7431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Flow 'volume_create_manager' (833503da-4509-4d09-b579-a3c1e36c0c2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:11 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=137,cinder:INSERT=60,cinder:UPDATE=200,cinder:DELETE=13 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:59:11 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-82e7c5c9-3c90-4d13-8918-9e14da6abab7 tempest-ProjectReaderTests-1666299680 None] Created volume successfully. Jul 08 02:59:11 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf Jul 08 02:59:11 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Acquiring lock "cinder-c6a202ec-5191-4ffc-9341-b901a5d65943-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Lock "cinder-c6a202ec-5191-4ffc-9341-b901a5d65943-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Acquiring lock "cinder-quobyte-c6a202ec-5191-4ffc-9341-b901a5d65943" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:12 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf" returned: 0 in 0.895s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Lock "cinder-quobyte-c6a202ec-5191-4ffc-9341-b901a5d65943" acquired by "delete_volume" :: waited 0.033s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:12 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3 1G Jul 08 02:59:12 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:12 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[68383529-ad59-46b2-a4dd-f3b2e333c66f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c6a202ec-5191-4ffc-9341-b901a5d65943 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:12 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c6a202ec-5191-4ffc-9341-b901a5d65943 Jul 08 02:59:12 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:13 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3 1G" returned: 0 in 0.892s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:13 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c6a202ec-5191-4ffc-9341-b901a5d65943" returned: 0 in 0.858s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c6a202ec-5191-4ffc-9341-b901a5d65943 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:13 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3 Jul 08 02:59:13 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:13 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c6a202ec-5191-4ffc-9341-b901a5d65943 Jul 08 02:59:13 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:14 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3" returned: 0 in 0.735s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:14 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3 is being set with open permissions: ugo+rw Jul 08 02:59:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:14 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c6a202ec-5191-4ffc-9341-b901a5d65943" returned: 0 in 0.748s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:14 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3 Jul 08 02:59:14 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:14 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Lock "cinder-quobyte-c6a202ec-5191-4ffc-9341-b901a5d65943" released by "delete_volume" :: held 1.660s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:14 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=143,cinder:INSERT=47,cinder:UPDATE=187,cinder:DELETE=18 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:59:14 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Created reservations ['1a3befec-b806-4b42-a8d8-9f450443fdb9', 'ffe14708-1ab5-4727-9b8b-8bb6a8ad720f', '0adbec2f-8e47-49df-a7c6-30631adc4d80', '989194f4-d794-4a17-a79c-4ddb245518fa'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:59:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:14 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:59:14 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:14 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3" returned: 0 in 0.667s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:14 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.info Jul 08 02:59:14 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:15 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.719s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:59:15 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Deleted volume successfully. Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c3df8a93-8d15-4f35-a4ac-5504554572ae tempest-ProjectReaderTests-1666299680 None] Lock "cinder-c6a202ec-5191-4ffc-9341-b901a5d65943-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Flow 'volume_create_manager' (8c27449b-7054-4f39-8924-46e587e47600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c976d0b-793d-4a6c-a8f3-73b40165fdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c976d0b-793d-4a6c-a8f3-73b40165fdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484146375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3074383b25e0404aac71a2d0c9fac458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:15Z,use_quota=True,user_id='f60a15290cd54d6bb40b9e7c5a957d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4744ee8-b425-42bc-af6d-12a472cc62a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4744ee8-b425-42bc-af6d-12a472cc62a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cada0ddb-ecdc-48d0-a6e9-59f370bc687d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cada0ddb-ecdc-48d0-a6e9-59f370bc687d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5', 'volume_name': 'volume-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526ab99b-9c05-4689-bf02-99bb1d426a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526ab99b-9c05-4689-bf02-99bb1d426a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf72cde1-874e-44a8-aaed-6594149fc941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:15 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Volume 3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5', 'volume_size': 1} Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:15 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.info" returned: 0 in 0.766s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:15 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.info is being set with open permissions: ugo+rw Jul 08 02:59:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:15 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.info Jul 08 02:59:15 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:16 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.info" returned: 0 in 0.688s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.762s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.037s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484146375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3074383b25e0404aac71a2d0c9fac458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:15Z,use_quota=True,user_id='f60a15290cd54d6bb40b9e7c5a957d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Creating volume 3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:59:16 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:16 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5 1073741824 Jul 08 02:59:16 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:16 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-af0d1946-cee3-4f4b-ab2b-c0ac1f76c517 tempest-ProjectMemberTests-1616543176 None] Create snapshot completed successfully Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-daf30570-5f09-488c-9e5d-d9a2af11b1e3-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-daf30570-5f09-488c-9e5d-d9a2af11b1e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-d8e10feb-75d2-4d99-bec4-41233f7f3bbf" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-d8e10feb-75d2-4d99-bec4-41233f7f3bbf" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-daf30570-5f09-488c-9e5d-d9a2af11b1e3" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-daf30570-5f09-488c-9e5d-d9a2af11b1e3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Deleting offline snapshot daf30570-5f09-488c-9e5d-d9a2af11b1e3 of volume d8e10feb-75d2-4d99-bec4-41233f7f3bbf {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] snapshot_file for this snap is: volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1673b3f-1572-4f1a-8162-3f8112e1047d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:17 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3 Jul 08 02:59:17 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:17 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5 1073741824" returned: 0 in 0.963s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:17 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5 Jul 08 02:59:17 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:17 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3" returned: 0 in 0.894s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:17 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:59:17 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afa01a4-27da-4e49-866d-78df2c815dd5]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:18 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf Jul 08 02:59:18 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:18 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5" returned: 0 in 0.723s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:18 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:59:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf72cde1-874e-44a8-aaed-6594149fc941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc66e60-e487-4a62-a71f-eba4dcab3f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:18 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Volume volume-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5 (3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5): created successfully Jul 08 02:59:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc66e60-e487-4a62-a71f-eba4dcab3f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:18 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Flow 'volume_create_manager' (8c27449b-7054-4f39-8924-46e587e47600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:18 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-15f38fec-04f0-4cba-919c-968c3c06d021 tempest-ProjectReaderTests-1666299680 None] Created volume successfully. Jul 08 02:59:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Acquiring lock "cinder-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Lock "cinder-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Acquiring lock "cinder-quobyte-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:18 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Lock "cinder-quobyte-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5" acquired by "delete_volume" :: waited 0.014s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:18 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[edac45e1-9f72-4559-aee3-378d2e3956dc]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:18 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5 Jul 08 02:59:18 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:18 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf" returned: 0 in 0.875s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:18 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3 Jul 08 02:59:18 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:19 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5" returned: 0 in 0.869s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:19 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5 Jul 08 02:59:19 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:19 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3" returned: 0 in 0.850s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:19 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3 Jul 08 02:59:19 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:20 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5" returned: 0 in 0.728s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Lock "cinder-quobyte-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5" released by "delete_volume" :: held 1.640s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:20 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Created reservations ['38c2c4a0-f566-4562-9b43-136f4aa79aba', '3cf88be8-3815-4c95-8b95-a67825f291e5', '64858060-c6c6-4739-b849-cd31af006c87', '1ca1c4b7-3349-4b01-8fce-9191c6724c27'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:59:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:20 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:59:20 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:20 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf.daf30570-5f09-488c-9e5d-d9a2af11b1e3" returned: 0 in 0.749s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-daf30570-5f09-488c-9e5d-d9a2af11b1e3" released by "_delete_snapshot" :: held 3.514s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-d8e10feb-75d2-4d99-bec4-41233f7f3bbf" released by "delete_snapshot" :: held 3.541s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:20 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Created reservations ['e586c836-2377-464c-ae2b-db75798f8043', '7492f358-20d8-4ee0-9778-60709e75db2a', 'b33c16b3-2712-4a62-bfa3-bb90baf74af6', '7fafc44c-0e34-48ec-bb44-4b43d4f736db'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:59:20 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Delete snapshot completed successfully. Jul 08 02:59:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-32f16061-1eb0-4691-9223-1be0984ab519 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-daf30570-5f09-488c-9e5d-d9a2af11b1e3-delete_snapshot" released by "delete_snapshot" :: held 3.694s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:21 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.686s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:21 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:59:21 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Deleted volume successfully. Jul 08 02:59:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2e360e54-7541-451f-b425-95dc11e6d52e tempest-ProjectReaderTests-1666299680 None] Lock "cinder-3411dcf7-b7e0-4bc5-92b3-a3afbabebeb5-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-d8e10feb-75d2-4d99-bec4-41233f7f3bbf-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-d8e10feb-75d2-4d99-bec4-41233f7f3bbf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-d8e10feb-75d2-4d99-bec4-41233f7f3bbf" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-d8e10feb-75d2-4d99-bec4-41233f7f3bbf" acquired by "delete_volume" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:21 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a22c252-7abb-4b9b-a43a-c56ea12fd842]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:21 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf Jul 08 02:59:21 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:22 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf" returned: 0 in 0.857s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:22 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf Jul 08 02:59:22 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:22 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-d8e10feb-75d2-4d99-bec4-41233f7f3bbf" returned: 0 in 0.768s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:22 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-d8e10feb-75d2-4d99-bec4-41233f7f3bbf" released by "delete_volume" :: held 1.703s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Created reservations ['c23686be-c904-4398-8dea-9f813aec66d2', '397989ae-e245-44b8-a436-a2e2ff0015f4', '7de11056-b784-47f6-bc22-19f20b31737b', '13feb7ee-2034-48ee-9bd8-d4e88345e716'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:23 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:59:23 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Flow 'volume_create_manager' (580c4962-7d25-40e8-a2af-11ea8ee3b399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0a7b33-9bc4-43a8-9b77-bdd9a75b3a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0a7b33-9bc4-43a8-9b77-bdd9a75b3a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1030872024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a512ad-4181-447a-a6b7-6c4b6cbff515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037a23e0d9b74861a3e8b75936fc1bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:23Z,use_quota=True,user_id='e0a24b000042493b881ffa480a170bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c84b52-8187-4b85-9826-6e549f60db0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c84b52-8187-4b85-9826-6e549f60db0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de3f8a6-1b2d-4658-a053-520fe2ba79f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de3f8a6-1b2d-4658-a053-520fe2ba79f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66a512ad-4181-447a-a6b7-6c4b6cbff515', 'volume_name': 'volume-66a512ad-4181-447a-a6b7-6c4b6cbff515', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c826f7-9760-4ccd-80fc-5f2934dfc501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c826f7-9760-4ccd-80fc-5f2934dfc501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118659cc-6da3-4c3b-b403-25bc9f3a47e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:23 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Volume 66a512ad-4181-447a-a6b7-6c4b6cbff515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66a512ad-4181-447a-a6b7-6c4b6cbff515', 'volume_size': 1} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1030872024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a512ad-4181-447a-a6b7-6c4b6cbff515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037a23e0d9b74861a3e8b75936fc1bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:23Z,use_quota=True,user_id='e0a24b000042493b881ffa480a170bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Creating volume 66a512ad-4181-447a-a6b7-6c4b6cbff515 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:59:23 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-66a512ad-4181-447a-a6b7-6c4b6cbff515 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:23 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-66a512ad-4181-447a-a6b7-6c4b6cbff515 1073741824 Jul 08 02:59:23 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:59:23 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (9082f6d5-0ef6-4c82-a2ee-fbf87646302d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea945ce-4411-4ebd-9c00-5f212a426c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.752s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:59:23 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Deleted volume successfully. Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea945ce-4411-4ebd-9c00-5f212a426c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1502049511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ce717f-1b76-4e3b-a428-2b05904b386c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:24Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894e7810-76a6-4e8b-b603-7bd036a67676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894e7810-76a6-4e8b-b603-7bd036a67676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57f99c9-55b6-4391-b184-ed3408763e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57f99c9-55b6-4391-b184-ed3408763e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ce717f-1b76-4e3b-a428-2b05904b386c', 'volume_name': 'volume-76ce717f-1b76-4e3b-a428-2b05904b386c', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd9a4b9-7ac1-47cc-b2f3-2f0c03de6efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd9a4b9-7ac1-47cc-b2f3-2f0c03de6efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5604eb-678a-4611-810c-b46e9d07fcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:23 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Volume 76ce717f-1b76-4e3b-a428-2b05904b386c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ce717f-1b76-4e3b-a428-2b05904b386c', 'volume_size': 1} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0231d3a6-a41a-4301-9f5a-5b6efa1bae66 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-d8e10feb-75d2-4d99-bec4-41233f7f3bbf-delete_volume" released by "delete_volume" :: held 2.804s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:24 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-66a512ad-4181-447a-a6b7-6c4b6cbff515 1073741824" returned: 0 in 0.861s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-66a512ad-4181-447a-a6b7-6c4b6cbff515 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:24 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-66a512ad-4181-447a-a6b7-6c4b6cbff515 Jul 08 02:59:24 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:24 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-66a512ad-4181-447a-a6b7-6c4b6cbff515" returned: 0 in 0.674s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.953s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1502049511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ce717f-1b76-4e3b-a428-2b05904b386c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:24Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Creating volume 76ce717f-1b76-4e3b-a428-2b05904b386c {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:59:24 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:24 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c 1073741824 Jul 08 02:59:24 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118659cc-6da3-4c3b-b403-25bc9f3a47e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66a512ad-4181-447a-a6b7-6c4b6cbff515', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e8fba2-7afc-48af-936c-680dbcdb98d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:24 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Volume volume-66a512ad-4181-447a-a6b7-6c4b6cbff515 (66a512ad-4181-447a-a6b7-6c4b6cbff515): created successfully Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e8fba2-7afc-48af-936c-680dbcdb98d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:24 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Flow 'volume_create_manager' (580c4962-7d25-40e8-a2af-11ea8ee3b399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:25 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-ae0614cd-a47d-4083-866c-d1b4fbb074e2 tempest-ProjectReaderTests-609227910 None] Created volume successfully. Jul 08 02:59:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Acquiring lock "cinder-66a512ad-4181-447a-a6b7-6c4b6cbff515-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Lock "cinder-66a512ad-4181-447a-a6b7-6c4b6cbff515-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Acquiring lock "cinder-quobyte-66a512ad-4181-447a-a6b7-6c4b6cbff515" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Lock "cinder-quobyte-66a512ad-4181-447a-a6b7-6c4b6cbff515" acquired by "delete_volume" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:25 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[15da3331-cff1-46b3-912d-c8145c7ff23f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-66a512ad-4181-447a-a6b7-6c4b6cbff515 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:25 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-66a512ad-4181-447a-a6b7-6c4b6cbff515 Jul 08 02:59:25 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:25 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c 1073741824" returned: 0 in 0.860s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:25 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c Jul 08 02:59:25 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:26 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-66a512ad-4181-447a-a6b7-6c4b6cbff515" returned: 0 in 0.801s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-66a512ad-4181-447a-a6b7-6c4b6cbff515 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:26 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-66a512ad-4181-447a-a6b7-6c4b6cbff515 Jul 08 02:59:26 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:26 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c" returned: 0 in 0.670s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:26 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:59:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:26 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5604eb-678a-4611-810c-b46e9d07fcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ce717f-1b76-4e3b-a428-2b05904b386c', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:26 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b18c16b-b206-4081-869b-feda19a9d228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:26 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Volume volume-76ce717f-1b76-4e3b-a428-2b05904b386c (76ce717f-1b76-4e3b-a428-2b05904b386c): created successfully Jul 08 02:59:26 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b18c16b-b206-4081-869b-feda19a9d228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:26 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (9082f6d5-0ef6-4c82-a2ee-fbf87646302d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:26 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-9a95d9ef-067b-4ccf-b0ad-cbda10b14c51 tempest-ProjectMemberTests-1616543176 None] Created volume successfully. Jul 08 02:59:27 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-66a512ad-4181-447a-a6b7-6c4b6cbff515" returned: 0 in 0.683s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Lock "cinder-quobyte-66a512ad-4181-447a-a6b7-6c4b6cbff515" released by "delete_volume" :: held 1.530s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] Creating offline snapshot 66eb504e-1588-4441-84cf-47a60fb0e8c3 of volume 76ce717f-1b76-4e3b-a428-2b05904b386c {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb80077b-b32e-4540-8be7-c5dc98dbe3cd]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Created reservations ['b95ab343-a935-40d0-96c0-144f9c96c62c', 'f3182e62-3f0c-4a84-833a-b06df888fe68', '76195574-2595-4857-a9d0-cb8c7545aece', '8ab00958-5306-4f91-ad6c-a5360e6ceb17'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:27 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c Jul 08 02:59:27 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:27 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:59:27 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:27 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.670s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:59:27 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Deleted volume successfully. Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-994290de-d3ac-4d7b-a9e0-051c0d32e0da tempest-ProjectReaderTests-609227910 None] Lock "cinder-66a512ad-4181-447a-a6b7-6c4b6cbff515-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:27 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c" returned: 0 in 0.809s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:28 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3 1G Jul 08 02:59:28 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:28 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:59:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Flow 'volume_create_manager' (e3aed43c-27c3-4726-b79b-dae8b159e5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585315a8-104b-4b18-8c16-7b159f5dc23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585315a8-104b-4b18-8c16-7b159f5dc23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1030402190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbcd34a8-ccfe-4cc0-8053-f86be07b4a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037a23e0d9b74861a3e8b75936fc1bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:28Z,use_quota=True,user_id='e0a24b000042493b881ffa480a170bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5838f02e-0be8-44be-a1b6-998df6f45221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5838f02e-0be8-44be-a1b6-998df6f45221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab71e30f-9d58-4dca-9900-c54189d1426a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab71e30f-9d58-4dca-9900-c54189d1426a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbcd34a8-ccfe-4cc0-8053-f86be07b4a80', 'volume_name': 'volume-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bb7511-3efc-4309-b99b-8f445a32f0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bb7511-3efc-4309-b99b-8f445a32f0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:28 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b51588-5ad9-4186-b9bb-e9e9c65042ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:28 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Volume fbcd34a8-ccfe-4cc0-8053-f86be07b4a80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80', 'volume_size': 1} Jul 08 02:59:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:28 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3 1G" returned: 0 in 0.814s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ce717f-1b76-4e3b-a428-2b05904b386c -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:28 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ce717f-1b76-4e3b-a428-2b05904b386c -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3 Jul 08 02:59:28 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:29 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ce717f-1b76-4e3b-a428-2b05904b386c -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3" returned: 0 in 0.689s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:29 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3 is being set with open permissions: ugo+rw Jul 08 02:59:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:29 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3 Jul 08 02:59:29 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:30 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3" returned: 0 in 0.637s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:30 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.info Jul 08 02:59:30 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:30 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.info" returned: 0 in 0.648s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:30 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.info is being set with open permissions: ugo+rw Jul 08 02:59:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:30 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.info Jul 08 02:59:30 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:31 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.info" returned: 0 in 0.652s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.329s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.171s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1030402190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbcd34a8-ccfe-4cc0-8053-f86be07b4a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037a23e0d9b74861a3e8b75936fc1bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:28Z,use_quota=True,user_id='e0a24b000042493b881ffa480a170bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:59:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Creating volume fbcd34a8-ccfe-4cc0-8053-f86be07b4a80 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:59:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:59:31 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:59:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:31 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80 1073741824 Jul 08 02:59:31 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:31 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-d2303593-de26-4f0c-968b-ea1439466a9c tempest-ProjectMemberTests-1616543176 None] Create snapshot completed successfully Jul 08 02:59:32 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80 1073741824" returned: 0 in 0.807s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:32 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80 Jul 08 02:59:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-66eb504e-1588-4441-84cf-47a60fb0e8c3-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:32 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Lock "cinder-66eb504e-1588-4441-84cf-47a60fb0e8c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-76ce717f-1b76-4e3b-a428-2b05904b386c" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-76ce717f-1b76-4e3b-a428-2b05904b386c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-66eb504e-1588-4441-84cf-47a60fb0e8c3" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:32 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-66eb504e-1588-4441-84cf-47a60fb0e8c3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Deleting offline snapshot 66eb504e-1588-4441-84cf-47a60fb0e8c3 of volume 76ce717f-1b76-4e3b-a428-2b05904b386c {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:59:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] snapshot_file for this snap is: volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:59:32 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[626a1e83-76e6-4de2-b73b-b87a18f436e2]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:32 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3 Jul 08 02:59:32 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:32 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80" returned: 0 in 0.675s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b51588-5ad9-4186-b9bb-e9e9c65042ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e4a0a8-57e8-4b1d-a2c3-c05526d635ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:33 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Volume volume-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80 (fbcd34a8-ccfe-4cc0-8053-f86be07b4a80): created successfully Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e4a0a8-57e8-4b1d-a2c3-c05526d635ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Flow 'volume_create_manager' (e3aed43c-27c3-4726-b79b-dae8b159e5d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:33 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3c7b8696-61d9-4564-85de-0418412b8cc6 tempest-ProjectReaderTests-609227910 None] Created volume successfully. Jul 08 02:59:33 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3" returned: 0 in 0.778s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76ce717f-1b76-4e3b-a428-2b05904b386c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[18398655-1bb5-416d-b4f1-a8a5a0f18bf4]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:33 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c Jul 08 02:59:33 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Acquiring lock "cinder-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Lock "cinder-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Acquiring lock "cinder-quobyte-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Lock "cinder-quobyte-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80" acquired by "delete_volume" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea65125-cd3c-42d9-8e19-cacd2a5eb30f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:33 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80 Jul 08 02:59:33 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:34 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c" returned: 0 in 0.789s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:34 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3 Jul 08 02:59:34 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:34 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80" returned: 0 in 0.808s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:34 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80 Jul 08 02:59:34 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:34 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3" returned: 0 in 0.755s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:34 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3 Jul 08 02:59:34 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:35 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80" returned: 0 in 0.657s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Lock "cinder-quobyte-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80" released by "delete_volume" :: held 1.508s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:35 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Created reservations ['e938cbca-fb4f-41bb-be7d-3fd3a82adbcd', '69a2a46d-fa2b-4938-aeac-22f0ac854a78', '006ab31f-6ef2-4c60-a026-a0562d9ba606', '5b1308f9-7a23-4cd3-90b1-fb6e8c0efe8a'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:59:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:35 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:35 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:59:35 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:35 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c.66eb504e-1588-4441-84cf-47a60fb0e8c3" returned: 0 in 0.661s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-66eb504e-1588-4441-84cf-47a60fb0e8c3" released by "_delete_snapshot" :: held 3.093s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-76ce717f-1b76-4e3b-a428-2b05904b386c" released by "delete_snapshot" :: held 3.118s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:35 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Created reservations ['def7a8e6-563e-4c22-a9ca-f1de3a46a202', 'dd9992f2-d391-4c2b-adb1-3322705f61e8', 'c6b4c063-7b66-45db-92d9-b0d2145f39a9', '8a12b04c-2679-4eb6-a4c2-da4735e44542'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:59:35 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Delete snapshot completed successfully. Jul 08 02:59:35 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-b4e82d2d-23db-45c5-8067-9adcfe03be2f tempest-ProjectMemberTests-1616543176 None] Lock "cinder-66eb504e-1588-4441-84cf-47a60fb0e8c3-delete_snapshot" released by "delete_snapshot" :: held 3.268s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:35 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.681s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:35 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:59:35 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Deleted volume successfully. Jul 08 02:59:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a99788c7-c899-4593-87fd-f4ac5425306c tempest-ProjectReaderTests-609227910 None] Lock "cinder-fbcd34a8-ccfe-4cc0-8053-f86be07b4a80-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-76ce717f-1b76-4e3b-a428-2b05904b386c-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-76ce717f-1b76-4e3b-a428-2b05904b386c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-76ce717f-1b76-4e3b-a428-2b05904b386c" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:36 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-76ce717f-1b76-4e3b-a428-2b05904b386c" acquired by "delete_volume" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:36 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[196fb84c-9358-4084-9088-73ff8830a0a0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:36 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c Jul 08 02:59:36 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:37 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c" returned: 0 in 0.821s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:37 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c Jul 08 02:59:37 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:38 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-76ce717f-1b76-4e3b-a428-2b05904b386c" returned: 0 in 0.663s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-76ce717f-1b76-4e3b-a428-2b05904b386c" released by "delete_volume" :: held 1.581s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:38 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Created reservations ['a81c2fb0-fac7-44b5-8242-bc61b73e1f53', '181d5540-5715-43ab-8391-0e9d4df66125', '3cd9e1d2-94bc-4606-840d-4f0fa33e207c', '060dbb1d-44d3-4a57-ad95-93512d04c63d'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:59:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:38 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:59:38 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:39 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.672s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:59:39 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Deleted volume successfully. Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-70ca154d-2822-44fe-8809-97f9a33251a3 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-76ce717f-1b76-4e3b-a428-2b05904b386c-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (b6e2c4db-5900-4473-910d-d9a9fc2d3ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676a2eb7-f364-42bb-88f1-7088e29db3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676a2eb7-f364-42bb-88f1-7088e29db3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-596870025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15290256-11c9-442f-a9ae-f251e63d12f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:39Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac81f43-9ff5-4be3-b6a9-dee34eb03bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac81f43-9ff5-4be3-b6a9-dee34eb03bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7702d8-d675-4259-b2ff-602d4947c798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7702d8-d675-4259-b2ff-602d4947c798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15290256-11c9-442f-a9ae-f251e63d12f0', 'volume_name': 'volume-15290256-11c9-442f-a9ae-f251e63d12f0', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a2bd0a-40d5-4042-a3ca-30d9538b3a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a2bd0a-40d5-4042-a3ca-30d9538b3a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3936fb10-7c09-4dd0-93a0-4edef604dcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:39 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Volume 15290256-11c9-442f-a9ae-f251e63d12f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15290256-11c9-442f-a9ae-f251e63d12f0', 'volume_size': 1} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-596870025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15290256-11c9-442f-a9ae-f251e63d12f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:39Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Creating volume 15290256-11c9-442f-a9ae-f251e63d12f0 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:59:39 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:59:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:39 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0 1073741824 Jul 08 02:59:39 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:40 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0 1073741824" returned: 0 in 0.878s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:40 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0 Jul 08 02:59:40 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:41 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0" returned: 0 in 0.639s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:59:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:41 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3936fb10-7c09-4dd0-93a0-4edef604dcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15290256-11c9-442f-a9ae-f251e63d12f0', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:41 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb560f9-ac50-4891-a28f-8c035e92a7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:41 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Volume volume-15290256-11c9-442f-a9ae-f251e63d12f0 (15290256-11c9-442f-a9ae-f251e63d12f0): created successfully Jul 08 02:59:41 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb560f9-ac50-4891-a28f-8c035e92a7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:41 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (b6e2c4db-5900-4473-910d-d9a9fc2d3ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:41 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-697e95e1-5c18-4aaa-9f39-90de677ac10a tempest-ProjectMemberTests-1616543176 None] Created volume successfully. Jul 08 02:59:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:41 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] Creating offline snapshot 91d28ef7-3376-4ca9-a049-883401f7a900 of volume 15290256-11c9-442f-a9ae-f251e63d12f0 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:59:41 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a95afdb-0f7f-4d88-b127-958bd74b7171]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:41 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0 Jul 08 02:59:41 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:42 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0" returned: 0 in 0.798s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:42 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900 1G Jul 08 02:59:42 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:43 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900 1G" returned: 0 in 0.848s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15290256-11c9-442f-a9ae-f251e63d12f0 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:43 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15290256-11c9-442f-a9ae-f251e63d12f0 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900 Jul 08 02:59:43 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:44 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15290256-11c9-442f-a9ae-f251e63d12f0 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900" returned: 0 in 0.760s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:44 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900 is being set with open permissions: ugo+rw Jul 08 02:59:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:44 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900 Jul 08 02:59:44 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:44 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900" returned: 0 in 0.667s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:44 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.info Jul 08 02:59:44 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:45 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.info" returned: 0 in 0.671s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:45 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.info is being set with open permissions: ugo+rw Jul 08 02:59:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:45 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.info Jul 08 02:59:45 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:46 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.info" returned: 0 in 0.663s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.501s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:46 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-7ead2a97-f6de-4772-9078-f66f9e7c0f82 tempest-ProjectMemberTests-1616543176 None] Create snapshot completed successfully Jul 08 02:59:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-91d28ef7-3376-4ca9-a049-883401f7a900-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-91d28ef7-3376-4ca9-a049-883401f7a900-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-15290256-11c9-442f-a9ae-f251e63d12f0" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-15290256-11c9-442f-a9ae-f251e63d12f0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-91d28ef7-3376-4ca9-a049-883401f7a900" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:46 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-91d28ef7-3376-4ca9-a049-883401f7a900" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:46 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Deleting offline snapshot 91d28ef7-3376-4ca9-a049-883401f7a900 of volume 15290256-11c9-442f-a9ae-f251e63d12f0 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:59:46 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] snapshot_file for this snap is: volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:59:46 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f06f1d1-de38-428f-b9a5-7d8bf4baaded]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:47 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900 Jul 08 02:59:47 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:59:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:47 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:59:47 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:47 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900" returned: 0 in 0.894s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15290256-11c9-442f-a9ae-f251e63d12f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:59:47 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[50177c05-11c0-44e2-b41e-ec88c42bdb1c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:48 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0 Jul 08 02:59:48 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:48 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.833s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:48 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:59:48 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:59:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:59:48 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:59:48 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0" returned: 0 in 0.898s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:48 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900 Jul 08 02:59:48 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:49 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900" returned: 0 in 0.934s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:49 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900 Jul 08 02:59:49 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:50 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0.91d28ef7-3376-4ca9-a049-883401f7a900" returned: 0 in 0.695s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-91d28ef7-3376-4ca9-a049-883401f7a900" released by "_delete_snapshot" :: held 3.540s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-15290256-11c9-442f-a9ae-f251e63d12f0" released by "delete_snapshot" :: held 3.567s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:50 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Created reservations ['02a5cb3e-1d44-4f87-afe6-6d910c227c8f', '781ec658-6ab7-4afc-855f-ac4cbe0da2a9', '147e87ff-d883-41ef-abb6-dbe47588ecc8', 'c25eef8c-a53c-4fda-bf16-baf650266783'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:59:50 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Delete snapshot completed successfully. Jul 08 02:59:50 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-caf9eb69-e608-496f-b29d-39a3243bbef5 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-91d28ef7-3376-4ca9-a049-883401f7a900-delete_snapshot" released by "delete_snapshot" :: held 3.747s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-15290256-11c9-442f-a9ae-f251e63d12f0-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-15290256-11c9-442f-a9ae-f251e63d12f0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-15290256-11c9-442f-a9ae-f251e63d12f0" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:59:51 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-15290256-11c9-442f-a9ae-f251e63d12f0" acquired by "delete_volume" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:59:51 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0231a2d1-6ba9-4b04-bed0-850e3a237ee4]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:51 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0 Jul 08 02:59:51 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:52 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0" returned: 0 in 0.822s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:52 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0 Jul 08 02:59:52 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:52 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-15290256-11c9-442f-a9ae-f251e63d12f0" returned: 0 in 0.731s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-15290256-11c9-442f-a9ae-f251e63d12f0" released by "delete_volume" :: held 1.627s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:52 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Created reservations ['0f8781e2-4519-4f0e-b21f-1662acaec094', '64eea27a-7280-4abe-85d4-55aa288e6744', 'a9de2392-d1ce-45ab-a9e0-8cad60393770', '39e459ce-f7f9-4086-86b4-5679464a2ecb'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:59:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:53 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 02:59:53 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:53 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.686s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:59:53 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Deleted volume successfully. Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-e3455c2c-d68d-4b94-b744-b85740363342 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-15290256-11c9-442f-a9ae-f251e63d12f0-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (0cc24007-d694-4de6-9d49-49ece32da6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fd7598-bf47-42c9-9b12-e80e226a9c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fd7598-bf47-42c9-9b12-e80e226a9c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-982600724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce3e4dc-9331-4d49-b5b0-bff362431253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:54Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3e8c8f-98ed-477d-a0da-7d1c5dc75222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3e8c8f-98ed-477d-a0da-7d1c5dc75222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8326f25d-0f92-4136-a3b9-f89a05929a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8326f25d-0f92-4136-a3b9-f89a05929a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ce3e4dc-9331-4d49-b5b0-bff362431253', 'volume_name': 'volume-4ce3e4dc-9331-4d49-b5b0-bff362431253', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcaaefb9-aff5-4716-9cbc-1786655045d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcaaefb9-aff5-4716-9cbc-1786655045d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68f65bb-192e-42e6-b819-c0203ac8f2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:53 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Volume 4ce3e4dc-9331-4d49-b5b0-bff362431253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ce3e4dc-9331-4d49-b5b0-bff362431253', 'volume_size': 1} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-982600724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce3e4dc-9331-4d49-b5b0-bff362431253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:59:54Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Creating volume 4ce3e4dc-9331-4d49-b5b0-bff362431253 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:59:53 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 02:59:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:53 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 1073741824 Jul 08 02:59:53 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:54 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 1073741824" returned: 0 in 0.877s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:54 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 Jul 08 02:59:54 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:55 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253" returned: 0 in 0.700s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:55 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:59:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:59:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68f65bb-192e-42e6-b819-c0203ac8f2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce3e4dc-9331-4d49-b5b0-bff362431253', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f585a3-27a5-43a7-b759-333b5aa28243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:59:55 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Volume volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 (4ce3e4dc-9331-4d49-b5b0-bff362431253): created successfully Jul 08 02:59:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f585a3-27a5-43a7-b759-333b5aa28243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:59:55 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (0cc24007-d694-4de6-9d49-49ece32da6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:59:55 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-4e97680a-e225-4891-b500-1e286ff3f4fb tempest-ProjectMemberTests-1616543176 None] Created volume successfully. Jul 08 02:59:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:59:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:59:56 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] Creating offline snapshot 72a93221-2dc1-486a-a4b5-78ddc934d836 of volume 4ce3e4dc-9331-4d49-b5b0-bff362431253 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:59:56 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[046f7d17-6b2c-497a-9e30-a21b272e2468]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:59:56 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:56 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 Jul 08 02:59:56 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:57 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253" returned: 0 in 0.840s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:57 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836 1G Jul 08 02:59:57 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:57 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836 1G" returned: 0 in 0.916s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:57 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836 Jul 08 02:59:57 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:58 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836" returned: 0 in 0.738s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:58 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836 is being set with open permissions: ugo+rw Jul 08 02:59:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:58 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836 Jul 08 02:59:58 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:59:59 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 08 02:59:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836" returned: 0 in 0.659s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:59:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:59:59 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.info Jul 08 02:59:59 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:00 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.info" returned: 0 in 0.667s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:00 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.info is being set with open permissions: ugo+rw Jul 08 03:00:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:00 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.info Jul 08 03:00:00 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:00 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.info" returned: 0 in 0.702s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.626s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:00 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-23a4f525-b72c-4adc-b91f-88a80d7d41f3 tempest-ProjectMemberTests-1616543176 None] Create snapshot completed successfully Jul 08 03:00:01 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-72a93221-2dc1-486a-a4b5-78ddc934d836-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:01 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Lock "cinder-72a93221-2dc1-486a-a4b5-78ddc934d836-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:01 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-4ce3e4dc-9331-4d49-b5b0-bff362431253" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:01 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-4ce3e4dc-9331-4d49-b5b0-bff362431253" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:01 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-72a93221-2dc1-486a-a4b5-78ddc934d836" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:01 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-72a93221-2dc1-486a-a4b5-78ddc934d836" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Deleting offline snapshot 72a93221-2dc1-486a-a4b5-78ddc934d836 of volume 4ce3e4dc-9331-4d49-b5b0-bff362431253 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:00:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] snapshot_file for this snap is: volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:00:01 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a0ec17-5500-4a19-8ea2-1ddacc165f88]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:01 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836 Jul 08 03:00:01 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:02 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836" returned: 0 in 0.869s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:02 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ce3e4dc-9331-4d49-b5b0-bff362431253(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:00:02 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ebdc22-9f25-47eb-9bcf-2ca10a8ea289]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:02 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 Jul 08 03:00:02 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Flow 'volume_create_manager' (d326e0b4-282c-4118-b71c-5c677cb6d47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfdfe5d-35cd-406f-b36e-3e4514220f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfdfe5d-35cd-406f-b36e-3e4514220f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1589992613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae55db9-54d0-47ef-83b4-6f2f4760ed30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202f31f66bca418a86ca65087f7ecb64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:00:03Z,use_quota=True,user_id='42f8064ac33249ff89c6543114b0dc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b9ac72-4ba9-4326-9f72-509b021a2ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b9ac72-4ba9-4326-9f72-509b021a2ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c130d181-5da5-4c9c-9c0c-439b14f4d5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c130d181-5da5-4c9c-9c0c-439b14f4d5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eae55db9-54d0-47ef-83b4-6f2f4760ed30', 'volume_name': 'volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61536bde-3eca-4b68-a25b-9b37a9c90c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61536bde-3eca-4b68-a25b-9b37a9c90c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e532ff2e-98ad-4455-afec-e59022b3d4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:03 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Volume eae55db9-54d0-47ef-83b4-6f2f4760ed30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30', 'volume_size': 1} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1589992613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae55db9-54d0-47ef-83b4-6f2f4760ed30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202f31f66bca418a86ca65087f7ecb64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:00:03Z,use_quota=True,user_id='42f8064ac33249ff89c6543114b0dc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Creating volume eae55db9-54d0-47ef-83b4-6f2f4760ed30 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:00:03 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:03 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253" returned: 0 in 0.822s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:03 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 1073741824 Jul 08 03:00:03 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:03 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836 Jul 08 03:00:03 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:04 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836" returned: 0 in 0.769s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:04 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836 Jul 08 03:00:04 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:04 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 1073741824" returned: 0 in 0.841s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:04 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 Jul 08 03:00:04 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:04 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253.72a93221-2dc1-486a-a4b5-78ddc934d836" returned: 0 in 0.653s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-72a93221-2dc1-486a-a4b5-78ddc934d836" released by "_delete_snapshot" :: held 3.234s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-4ce3e4dc-9331-4d49-b5b0-bff362431253" released by "delete_snapshot" :: held 3.258s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:04 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:04 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Created reservations ['8455402e-61a6-403d-96a6-516712266282', '124ac516-eb8f-4be1-b76b-6f2aa44d4a47', '0c054e71-1ad4-4583-9882-88ed1f835830', '7da62563-e21f-4cfc-bd61-4b1a1a9e6c38'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:00:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30" returned: 0 in 0.651s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:04 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:00:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e532ff2e-98ad-4455-afec-e59022b3d4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9547a8d3-4efd-41ac-8922-f20b6c7bb9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:04 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Volume volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 (eae55db9-54d0-47ef-83b4-6f2f4760ed30): created successfully Jul 08 03:00:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9547a8d3-4efd-41ac-8922-f20b6c7bb9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:04 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Flow 'volume_create_manager' (d326e0b4-282c-4118-b71c-5c677cb6d47b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:00:04 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2af1b1d8-16a1-4704-a133-e03b3bfbf3bc tempest-SnapshotDependencyTests-1065414358 None] Created volume successfully. Jul 08 03:00:04 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Delete snapshot completed successfully. Jul 08 03:00:04 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-8d7e9267-58a5-4bea-8708-f317c8dc0e2b tempest-ProjectMemberTests-1616543176 None] Lock "cinder-72a93221-2dc1-486a-a4b5-78ddc934d836-delete_snapshot" released by "delete_snapshot" :: held 3.431s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:05 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] Creating offline snapshot 4335ed04-8864-4731-ba17-f9ea150c876f of volume eae55db9-54d0-47ef-83b4-6f2f4760ed30 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:00:05 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[497e32db-2326-48d9-94a2-477da634e1a7]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:05 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 Jul 08 03:00:05 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-4ce3e4dc-9331-4d49-b5b0-bff362431253-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Lock "cinder-4ce3e4dc-9331-4d49-b5b0-bff362431253-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-4ce3e4dc-9331-4d49-b5b0-bff362431253" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:05 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-4ce3e4dc-9331-4d49-b5b0-bff362431253" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:05 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[0645ecde-b77a-4838-9944-faa9ac76464d]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:05 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 Jul 08 03:00:05 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:06 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30" returned: 0 in 0.762s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:06 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f 1G Jul 08 03:00:06 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:06 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253" returned: 0 in 0.804s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:06 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253 Jul 08 03:00:06 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:06 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f 1G" returned: 0 in 0.769s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:07 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f Jul 08 03:00:07 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:07 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-4ce3e4dc-9331-4d49-b5b0-bff362431253" returned: 0 in 0.668s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-4ce3e4dc-9331-4d49-b5b0-bff362431253" released by "delete_volume" :: held 1.542s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:07 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Created reservations ['9e83e00e-1517-484b-9a9c-764abb74e12e', 'b92c0468-9b49-42f8-aae2-d12a3cc46bb2', 'e1fb16e5-8092-4fd3-be08-f75ad61a165c', '8954ce70-9ad9-41a0-a7a7-6c007b1b010f'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:00:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:00:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:00:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:07 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 03:00:07 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:07 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f" returned: 0 in 0.707s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:07 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f is being set with open permissions: ugo+rw Jul 08 03:00:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:07 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f Jul 08 03:00:07 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:08 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.708s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:00:08 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Deleted volume successfully. Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-2608fed8-e333-46a2-8cd0-44b7922c04cb tempest-ProjectMemberTests-1616543176 None] Lock "cinder-4ce3e4dc-9331-4d49-b5b0-bff362431253-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (550f4377-08a9-4814-b10e-a6c3327efea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abec996e-dd7c-47aa-9c7c-35ccec3f1c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abec996e-dd7c-47aa-9c7c-35ccec3f1c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329540695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede5fd9d-ace3-49f1-bca1-acca5ff9b37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:00:08Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcda508-f1c0-4a6d-a3d4-7d9d96b7a89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcda508-f1c0-4a6d-a3d4-7d9d96b7a89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd64330-6765-459e-9514-751193105932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd64330-6765-459e-9514-751193105932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ede5fd9d-ace3-49f1-bca1-acca5ff9b37d', 'volume_name': 'volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a84b6f-ec6a-4d0d-a85b-feea8f810c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a84b6f-ec6a-4d0d-a85b-feea8f810c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d60f0e-4404-42b0-94f1-9b9bf4bd0265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:08 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Volume ede5fd9d-ace3-49f1-bca1-acca5ff9b37d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d', 'volume_size': 1} Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:08 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f" returned: 0 in 0.791s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:08 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.info Jul 08 03:00:08 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:09 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.info" returned: 0 in 0.634s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:09 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.info is being set with open permissions: ugo+rw Jul 08 03:00:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:09 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.info Jul 08 03:00:09 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:09 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.info" returned: 0 in 0.644s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.388s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.369s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329540695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede5fd9d-ace3-49f1-bca1-acca5ff9b37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:00:08Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:00:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Creating volume ede5fd9d-ace3-49f1-bca1-acca5ff9b37d {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:00:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:00:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:00:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:09 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:00:09 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 03:00:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:09 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d 1073741824 Jul 08 03:00:09 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:09 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-e4453e0d-fad1-475a-8c6e-1a0f0ad54cf2 tempest-SnapshotDependencyTests-1065414358 None] Create snapshot completed successfully Jul 08 03:00:10 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d 1073741824" returned: 0 in 0.810s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:10 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d Jul 08 03:00:10 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Flow 'volume_create_manager' (b352a513-1f6c-4561-8d16-7e925bd167a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d84670-3b98-4003-8625-d61327689c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d84670-3b98-4003-8625-d61327689c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ea2ae9-c78f-4cf5-8691-0611b6e775d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202f31f66bca418a86ca65087f7ecb64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4335ed04-8864-4731-ba17-f9ea150c876f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:00:11Z,use_quota=True,user_id='42f8064ac33249ff89c6543114b0dc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed8f107-b0d2-44ff-a9a0-2150c87739dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed8f107-b0d2-44ff-a9a0-2150c87739dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3659b274-2720-4be9-ae51-ec618d5569e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3659b274-2720-4be9-ae51-ec618d5569e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c0ea2ae9-c78f-4cf5-8691-0611b6e775d3', 'volume_name': 'volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3', 'volume_size': 1, 'snapshot_id': '4335ed04-8864-4731-ba17-f9ea150c876f'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb40438-7638-49f4-a651-02faea6b6a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb40438-7638-49f4-a651-02faea6b6a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612dcec7-0415-497d-8b57-612a909d1d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:11 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Volume c0ea2ae9-c78f-4cf5-8691-0611b6e775d3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3', 'volume_size': 1, 'snapshot_id': '4335ed04-8864-4731-ba17-f9ea150c876f'} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:11 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d" returned: 0 in 0.653s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.018s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "cinder-quobyte-4335ed04-8864-4731-ba17-f9ea150c876f-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3" by "_create_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d60f0e-4404-42b0-94f1-9b9bf4bd0265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d15e4d-b441-4013-9828-d272b5b50119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-quobyte-4335ed04-8864-4731-ba17-f9ea150c876f-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Creating volume c0ea2ae9-c78f-4cf5-8691-0611b6e775d3 from snapshot 4335ed04-8864-4731-ba17-f9ea150c876f {{(pid=87238) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "cinder-quobyte-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3" by "_copy_volume_from_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-quobyte-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] snapshot: 4335ed04-8864-4731-ba17-f9ea150c876f, volume: c0ea2ae9-c78f-4cf5-8691-0611b6e775d3, {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 03:00:11 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Volume volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d (ede5fd9d-ace3-49f1-bca1-acca5ff9b37d): created successfully Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d15e4d-b441-4013-9828-d272b5b50119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (550f4377-08a9-4814-b10e-a6c3327efea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:11 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f75588a3-135a-4ba2-9df7-39dae994b3a2 tempest-ProjectMemberTests-1616543176 None] Created volume successfully. Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cf2d69-ce78-4b29-9872-031626a09a24]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:11 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f Jul 08 03:00:11 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:12 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f" returned: 0 in 0.739s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:12 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:00:12 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 03:00:12 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Creating direct copy from snapshot {{(pid=87238) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 03:00:12 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fdd445-703b-41c0-b994-15945920fbaf]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:12 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 Jul 08 03:00:12 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:12 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=125,cinder:SELECT=91,cinder:INSERT=29,cinder:DELETE=10 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:00:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:12 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30" returned: 0 in 0.773s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:12 devstack cinder-volume[87238]: DEBUG cinder.utils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Path /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3 not found in is_blk_device check {{(pid=87238) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 03:00:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:12 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3 Jul 08 03:00:12 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:17 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3" returned: 0 in 4.472s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:17 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ca0a5b-633c-4c38-9b0b-cd31c0831530]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:17 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 Jul 08 03:00:17 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:18 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30" returned: 0 in 0.945s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:18 devstack cinder-volume[87238]: DEBUG cinder.image.image_utils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30, size 1024.00 MB, duration 4.47 sec, destination /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3 {{(pid=87238) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:00:18 devstack cinder-volume[87238]: INFO cinder.image.image_utils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Converted 1024.00 MB image at 228.93 MB/s Jul 08 03:00:18 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3 is being set with open permissions: ugo+rw Jul 08 03:00:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:18 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3 Jul 08 03:00:18 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:19 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3" returned: 0 in 0.646s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-quobyte-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3" released by "_copy_volume_from_snapshot" :: held 7.680s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-quobyte-4335ed04-8864-4731-ba17-f9ea150c876f-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3" released by "_create_volume_from_snapshot" :: held 7.716s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.741s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.359s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=112,cinder:SELECT=93,cinder:INSERT=32,cinder:DELETE=11 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] Creating offline snapshot 7368e2ed-ed7c-4430-9a42-cd90e94f5950 of volume ede5fd9d-ace3-49f1-bca1-acca5ff9b37d {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b4f685-a718-42a9-ac5e-d92f816f5534]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612dcec7-0415-497d-8b57-612a909d1d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3', 'volume_size': 1, 'snapshot_id': '4335ed04-8864-4731-ba17-f9ea150c876f'}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3235f2e-f30b-4804-8591-b5ef0411cdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:19 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Volume volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3 (c0ea2ae9-c78f-4cf5-8691-0611b6e775d3): created successfully Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3235f2e-f30b-4804-8591-b5ef0411cdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Flow 'volume_create_manager' (b352a513-1f6c-4561-8d16-7e925bd167a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:00:19 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-1b418904-8a70-4bcb-a7c3-b4703e7a5baf tempest-SnapshotDependencyTests-1065414358 None] Created volume successfully. Jul 08 03:00:19 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d Jul 08 03:00:19 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:19 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d" returned: 0 in 0.772s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:19 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950 1G Jul 08 03:00:19 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "cinder-4335ed04-8864-4731-ba17-f9ea150c876f-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-4335ed04-8864-4731-ba17-f9ea150c876f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "cinder-quobyte-eae55db9-54d0-47ef-83b4-6f2f4760ed30" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-quobyte-eae55db9-54d0-47ef-83b4-6f2f4760ed30" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:19 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "cinder-quobyte-4335ed04-8864-4731-ba17-f9ea150c876f" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:20 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-quobyte-4335ed04-8864-4731-ba17-f9ea150c876f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Deleting offline snapshot 4335ed04-8864-4731-ba17-f9ea150c876f of volume eae55db9-54d0-47ef-83b4-6f2f4760ed30 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:00:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] snapshot_file for this snap is: volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:00:20 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac217aa-1b6c-437a-adbc-83d83fa81914]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:20 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f Jul 08 03:00:20 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:20 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950 1G" returned: 0 in 0.809s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:20 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950 Jul 08 03:00:20 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:20 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f" returned: 0 in 0.800s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:20 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:00:20 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e21247-ee6a-43a6-b5f4-14feee20abac]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:20 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 Jul 08 03:00:20 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:21 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950" returned: 0 in 0.678s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:21 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950 is being set with open permissions: ugo+rw Jul 08 03:00:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:21 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950 Jul 08 03:00:21 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:21 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30" returned: 0 in 0.766s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:21 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f Jul 08 03:00:21 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:22 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950" returned: 0 in 0.660s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:22 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.info Jul 08 03:00:22 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:22 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f" returned: 0 in 0.734s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:22 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f Jul 08 03:00:22 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:22 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.info" returned: 0 in 0.680s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:22 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.info is being set with open permissions: ugo+rw Jul 08 03:00:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:22 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.info Jul 08 03:00:22 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:23 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30.4335ed04-8864-4731-ba17-f9ea150c876f" returned: 0 in 0.637s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-quobyte-4335ed04-8864-4731-ba17-f9ea150c876f" released by "_delete_snapshot" :: held 3.042s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-quobyte-eae55db9-54d0-47ef-83b4-6f2f4760ed30" released by "delete_snapshot" :: held 3.065s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:23 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Created reservations ['84450e39-5bda-4ab5-9b02-3d3f44e08b90', '042cd677-c829-4352-ba51-f10635ec8c51', 'bd247edd-3d12-408a-83ad-60ef0ddee1e1', 'c39c3800-ea19-47d5-9fd8-b6c0fdfca6cb'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:00:23 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Delete snapshot completed successfully. Jul 08 03:00:23 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c68483f1-5a4e-4f7a-80e2-16f43dabe487 tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-4335ed04-8864-4731-ba17-f9ea150c876f-delete_snapshot" released by "delete_snapshot" :: held 3.214s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:23 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.info" returned: 0 in 0.632s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.321s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:23 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-3d66fbf3-f5b2-47d0-9fc8-98f15d56d89a tempest-ProjectMemberTests-1616543176 None] Create snapshot completed successfully Jul 08 03:00:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "cinder-eae55db9-54d0-47ef-83b4-6f2f4760ed30-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-eae55db9-54d0-47ef-83b4-6f2f4760ed30-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-7368e2ed-ed7c-4430-9a42-cd90e94f5950-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "cinder-quobyte-eae55db9-54d0-47ef-83b4-6f2f4760ed30" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Lock "cinder-7368e2ed-ed7c-4430-9a42-cd90e94f5950-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-quobyte-eae55db9-54d0-47ef-83b4-6f2f4760ed30" acquired by "delete_volume" :: waited 0.025s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-7368e2ed-ed7c-4430-9a42-cd90e94f5950" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-7368e2ed-ed7c-4430-9a42-cd90e94f5950" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Deleting offline snapshot 7368e2ed-ed7c-4430-9a42-cd90e94f5950 of volume ede5fd9d-ace3-49f1-bca1-acca5ff9b37d {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:00:24 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] snapshot_file for this snap is: volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:00:24 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[73265dab-3533-4c02-bfa1-2fe3cc5cc63f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:24 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b017159-e325-47db-a182-288326c22bef]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:24 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 Jul 08 03:00:24 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:24 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950 Jul 08 03:00:24 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:25 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30" returned: 0 in 0.755s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:25 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950" returned: 0 in 0.756s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:00:25 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30 Jul 08 03:00:25 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c86a242-fb62-4239-bfcb-02573738d45c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:25 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d Jul 08 03:00:25 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:25 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-eae55db9-54d0-47ef-83b4-6f2f4760ed30" returned: 0 in 0.648s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-quobyte-eae55db9-54d0-47ef-83b4-6f2f4760ed30" released by "delete_volume" :: held 1.490s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Created reservations ['9df7c966-9bea-452a-8e1c-0962f49cf1a5', 'c430c178-636a-4a29-abb5-304a7e7f43a3', '8e09d7c5-881f-4dc6-a6f5-c1193b49762a', 'f0f165f5-b0f3-4244-a368-8af030f18db8'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:25 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 03:00:25 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:25 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d" returned: 0 in 0.816s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:26 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950 Jul 08 03:00:26 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "cinder-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "cinder-quobyte-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-quobyte-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:26 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[e196bc8f-3ab3-482e-9d3e-d0702ee40a5c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:26 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.695s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:26 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:00:26 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Deleted volume successfully. Jul 08 03:00:26 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-7fdd253e-d274-47d6-a774-7320ed479163 tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-eae55db9-54d0-47ef-83b4-6f2f4760ed30-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:26 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3 Jul 08 03:00:26 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:26 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950" returned: 0 in 0.836s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:26 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950 Jul 08 03:00:26 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:27 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3" returned: 0 in 0.761s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:27 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3 Jul 08 03:00:27 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:27 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d.7368e2ed-ed7c-4430-9a42-cd90e94f5950" returned: 0 in 0.659s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-7368e2ed-ed7c-4430-9a42-cd90e94f5950" released by "_delete_snapshot" :: held 3.170s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d" released by "delete_snapshot" :: held 3.193s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:27 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Created reservations ['c651c0e2-17fc-4e91-be31-99a958be7af7', 'f7ac39f0-3ad3-4389-b8d5-89054224ffaa', 'b035480e-bc12-4368-8950-52b14a3f5990', 'a81ea146-d649-4c33-b8e6-dd9166c47e54'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:00:27 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Delete snapshot completed successfully. Jul 08 03:00:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6952f802-db16-4ef7-8ccb-6b5657213f2f tempest-ProjectMemberTests-1616543176 None] Lock "cinder-7368e2ed-ed7c-4430-9a42-cd90e94f5950-delete_snapshot" released by "delete_snapshot" :: held 3.370s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:27 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3" returned: 0 in 0.629s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-quobyte-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3" released by "delete_volume" :: held 1.435s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:27 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Created reservations ['4703a464-6c9b-4ca7-964e-c1d482f45b4c', 'abe37bc6-bfee-4d58-b207-6dd02992831e', '4f8262ef-6297-4625-8a33-a1bef53e5f9f', 'e2d274bd-2156-415d-9e32-8710f04b8ac6'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:00:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:00:28 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:00:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:28 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 03:00:28 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Lock "cinder-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d" acquired by "delete_volume" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:28 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a42f16f-1cad-43e3-95df-ad72b95db1ba]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:28 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.640s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:28 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:00:28 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Deleted volume successfully. Jul 08 03:00:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-a4c63ac5-86dd-4acd-a822-3492ebd29e6d tempest-SnapshotDependencyTests-1065414358 None] Lock "cinder-c0ea2ae9-c78f-4cf5-8691-0611b6e775d3-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:28 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d Jul 08 03:00:28 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:29 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d" returned: 0 in 0.799s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:29 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:29 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d Jul 08 03:00:29 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:30 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d" returned: 0 in 0.661s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:30 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d" released by "delete_volume" :: held 1.531s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:30 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Created reservations ['2c9e20af-dd18-4e56-8362-1e5506629d26', '04d02486-e8c1-44a4-93b0-62445a52b58a', 'eb312703-40a2-486f-8b5e-1ed88909dc42', '26dcda86-bd1f-4610-a89c-4adcc1c3b17b'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:00:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:00:30 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:00:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:30 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 03:00:30 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:30 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:30 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.681s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:30 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:00:30 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Deleted volume successfully. Jul 08 03:00:30 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-c077fe91-5ca3-4a0d-bedd-e18a5baf282f tempest-ProjectMemberTests-1616543176 None] Lock "cinder-ede5fd9d-ace3-49f1-bca1-acca5ff9b37d-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (db96b501-7cc4-44b9-9804-48533b650eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc8c305-0d5f-4412-8a6a-fa2b9d5e02bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc8c305-0d5f-4412-8a6a-fa2b9d5e02bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1808097008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd1c65f-d702-4ace-a0f8-d450e3133cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:00:31Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf1d62c-a01c-46b5-ba75-b1a44de5d283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf1d62c-a01c-46b5-ba75-b1a44de5d283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca72f5c-53aa-4cf6-8c1c-503db0b43ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca72f5c-53aa-4cf6-8c1c-503db0b43ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bd1c65f-d702-4ace-a0f8-d450e3133cff', 'volume_name': 'volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1f784d-784b-4119-8ca8-b2a72c9ad6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1f784d-784b-4119-8ca8-b2a72c9ad6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7bc3ed-c32a-43b9-a162-6f2f26010756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:31 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Volume 7bd1c65f-d702-4ace-a0f8-d450e3133cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff', 'volume_size': 1} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1808097008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd1c65f-d702-4ace-a0f8-d450e3133cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:00:31Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Creating volume 7bd1c65f-d702-4ace-a0f8-d450e3133cff {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:00:31 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 03:00:31 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:31 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff 1073741824 Jul 08 03:00:31 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:32 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff 1073741824" returned: 0 in 0.940s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:32 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff Jul 08 03:00:32 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:32 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff" returned: 0 in 0.674s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:32 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:00:32 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7bc3ed-c32a-43b9-a162-6f2f26010756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e5295e-fbde-48d7-ba83-f013b352cca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:33 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Volume volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff (7bd1c65f-d702-4ace-a0f8-d450e3133cff): created successfully Jul 08 03:00:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e5295e-fbde-48d7-ba83-f013b352cca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:33 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (db96b501-7cc4-44b9-9804-48533b650eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:00:33 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-31e37213-d569-4d3f-89a5-2b9411019ab1 tempest-ProjectMemberTests-1616543176 None] Created volume successfully. Jul 08 03:00:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:33 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] Creating offline snapshot 4f345442-b94c-44f4-bdfd-7ac79029bbcf of volume 7bd1c65f-d702-4ace-a0f8-d450e3133cff {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:00:33 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[026ea787-a59c-41b6-b10b-109476b0574f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:33 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:33 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff Jul 08 03:00:33 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:34 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff" returned: 0 in 0.902s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:34 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:34 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf 1G Jul 08 03:00:34 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:35 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf 1G" returned: 0 in 0.832s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:35 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf Jul 08 03:00:35 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:35 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf" returned: 0 in 0.758s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:35 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf is being set with open permissions: ugo+rw Jul 08 03:00:35 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:36 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf Jul 08 03:00:36 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:36 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf" returned: 0 in 0.677s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:36 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:36 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.info Jul 08 03:00:36 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:37 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.info" returned: 0 in 0.680s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:37 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.info is being set with open permissions: ugo+rw Jul 08 03:00:37 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:37 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.info Jul 08 03:00:37 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:38 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.info" returned: 0 in 0.674s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.617s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:38 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-50dc8857-8bf3-4d32-ae17-b21525719ffb tempest-ProjectMemberTests-1616543176 None] Create snapshot completed successfully Jul 08 03:00:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-4f345442-b94c-44f4-bdfd-7ac79029bbcf-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-4f345442-b94c-44f4-bdfd-7ac79029bbcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-7bd1c65f-d702-4ace-a0f8-d450e3133cff" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-7bd1c65f-d702-4ace-a0f8-d450e3133cff" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-4f345442-b94c-44f4-bdfd-7ac79029bbcf" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:38 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-4f345442-b94c-44f4-bdfd-7ac79029bbcf" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Deleting offline snapshot 4f345442-b94c-44f4-bdfd-7ac79029bbcf of volume 7bd1c65f-d702-4ace-a0f8-d450e3133cff {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:00:38 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] snapshot_file for this snap is: volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:00:38 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d71043-bea2-43ea-9296-d95bb77b672f]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:38 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:38 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf Jul 08 03:00:38 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:39 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf" returned: 0 in 0.764s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:39 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:00:39 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75b49a0-474d-4e63-9b00-7c59d425129c]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:39 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:39 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff Jul 08 03:00:39 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:40 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff" returned: 0 in 0.765s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:40 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:40 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf Jul 08 03:00:40 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:41 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf" returned: 0 in 0.722s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:41 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf Jul 08 03:00:41 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:41 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:41 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff.4f345442-b94c-44f4-bdfd-7ac79029bbcf" returned: 0 in 0.656s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:41 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-4f345442-b94c-44f4-bdfd-7ac79029bbcf" released by "_delete_snapshot" :: held 3.003s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:41 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-7bd1c65f-d702-4ace-a0f8-d450e3133cff" released by "delete_snapshot" :: held 3.023s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:41 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Created reservations ['1cd8b688-067c-4309-af45-e652d00156d5', '1f382481-7128-4361-8b9d-170893b2288d', '31c09391-f6b9-4ea1-b6ca-607b7eabd6f1', 'b5c29b9a-6eeb-47ac-8f9e-7ab8b6a648d5'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:00:41 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Delete snapshot completed successfully. Jul 08 03:00:41 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-6e879fc2-20be-424b-b320-3a1a5ddba9b1 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-4f345442-b94c-44f4-bdfd-7ac79029bbcf-delete_snapshot" released by "delete_snapshot" :: held 3.162s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-7bd1c65f-d702-4ace-a0f8-d450e3133cff-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Lock "cinder-7bd1c65f-d702-4ace-a0f8-d450e3133cff-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-7bd1c65f-d702-4ace-a0f8-d450e3133cff" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:42 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-7bd1c65f-d702-4ace-a0f8-d450e3133cff" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:42 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[be002c8b-39f7-44e3-a7d7-58355ad52696]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:42 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:43 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff Jul 08 03:00:43 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:43 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff" returned: 0 in 0.780s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:43 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:43 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff Jul 08 03:00:43 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:44 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-7bd1c65f-d702-4ace-a0f8-d450e3133cff" returned: 0 in 0.676s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:44 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-7bd1c65f-d702-4ace-a0f8-d450e3133cff" released by "delete_volume" :: held 1.508s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:44 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Created reservations ['57cd1066-e3e0-4774-ae9a-8482602365f7', 'cd963fe5-8aa9-41cf-941d-31d80fe6c9e7', '0cc2dbfa-208a-46da-bcd6-0f56cfd702e5', '5c2612f9-f192-4280-8130-ed46d8e979cc'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:00:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:44 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:00:44 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:00:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:44 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:44 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 03:00:44 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:45 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.643s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:00:45 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Deleted volume successfully. Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-db6834bb-5c73-4718-8ef2-e0ac778fa7ee tempest-ProjectMemberTests-1616543176 None] Lock "cinder-7bd1c65f-d702-4ace-a0f8-d450e3133cff-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (7307492a-0ec4-4cab-826e-d4b0d1db3ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf0e503-e86f-4c7d-bfe2-4a441d176441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf0e503-e86f-4c7d-bfe2-4a441d176441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2118062965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d28b7f-b63f-43dd-9d6a-611fd3768c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:00:45Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0729dc-12e6-4a5d-b1d3-c22d0c375f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0729dc-12e6-4a5d-b1d3-c22d0c375f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db95b13-70ee-4872-904a-b8c32f0ac524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db95b13-70ee-4872-904a-b8c32f0ac524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d28b7f-b63f-43dd-9d6a-611fd3768c77', 'volume_name': 'volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6394f86a-0b67-49ad-9665-49b428f71d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6394f86a-0b67-49ad-9665-49b428f71d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d617cfb-6a55-4646-b27f-deb605e7cbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:45 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Volume 44d28b7f-b63f-43dd-9d6a-611fd3768c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77', 'volume_size': 1} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2118062965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d28b7f-b63f-43dd-9d6a-611fd3768c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:00:45Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Creating volume 44d28b7f-b63f-43dd-9d6a-611fd3768c77 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:00:45 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 03:00:45 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:45 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 1073741824 Jul 08 03:00:45 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:46 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 1073741824" returned: 0 in 0.797s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:46 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:46 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 Jul 08 03:00:46 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:47 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77" returned: 0 in 0.625s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d617cfb-6a55-4646-b27f-deb605e7cbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237a6047-5631-4425-8929-897c2ad9ae73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:47 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Volume volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 (44d28b7f-b63f-43dd-9d6a-611fd3768c77): created successfully Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237a6047-5631-4425-8929-897c2ad9ae73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (7307492a-0ec4-4cab-826e-d4b0d1db3ead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:00:47 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-2ebf10f8-c446-4d7e-9578-2492c83b2e81 tempest-ProjectMemberTests-1616543176 None] Created volume successfully. Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:47 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 03:00:47 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] Creating offline snapshot 25b09e2c-44ea-455a-9e4f-17145d6cf363 of volume 44d28b7f-b63f-43dd-9d6a-611fd3768c77 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c13725-aef8-440d-bea4-e1fd89228d72]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:47 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 Jul 08 03:00:47 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:47 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.668s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:00:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:00:48 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77" returned: 0 in 0.751s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:48 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:48 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363 1G Jul 08 03:00:48 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:49 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363 1G" returned: 0 in 0.791s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:49 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363 Jul 08 03:00:49 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:49 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363" returned: 0 in 0.677s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:49 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363 is being set with open permissions: ugo+rw Jul 08 03:00:49 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:49 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363 Jul 08 03:00:49 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:50 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363" returned: 0 in 0.654s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:50 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:50 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.info Jul 08 03:00:50 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:51 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.info" returned: 0 in 0.644s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:51 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.info is being set with open permissions: ugo+rw Jul 08 03:00:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:51 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.info Jul 08 03:00:51 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:51 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.info" returned: 0 in 0.617s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:51 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.218s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:51 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-68366124-bc81-498d-bbe4-95d8629520fd tempest-ProjectMemberTests-1616543176 None] Create snapshot completed successfully Jul 08 03:00:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-25b09e2c-44ea-455a-9e4f-17145d6cf363-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Lock "cinder-25b09e2c-44ea-455a-9e4f-17145d6cf363-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-44d28b7f-b63f-43dd-9d6a-611fd3768c77" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-44d28b7f-b63f-43dd-9d6a-611fd3768c77" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-25b09e2c-44ea-455a-9e4f-17145d6cf363" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:52 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-25b09e2c-44ea-455a-9e4f-17145d6cf363" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Deleting offline snapshot 25b09e2c-44ea-455a-9e4f-17145d6cf363 of volume 44d28b7f-b63f-43dd-9d6a-611fd3768c77 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:00:52 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] snapshot_file for this snap is: volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:00:52 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[568a6eeb-dee8-4eef-8208-f9dc1596bc94]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:52 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:53 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363 Jul 08 03:00:53 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:53 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363" returned: 0 in 0.739s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:53 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:00:53 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[9909a8c9-174f-4d9f-afb7-f79734de2176]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:53 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:53 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 Jul 08 03:00:53 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:54 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77" returned: 0 in 0.802s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:54 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:54 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363 Jul 08 03:00:54 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:55 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363" returned: 0 in 0.763s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:55 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363 Jul 08 03:00:55 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:55 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:55 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77.25b09e2c-44ea-455a-9e4f-17145d6cf363" returned: 0 in 0.624s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-25b09e2c-44ea-455a-9e4f-17145d6cf363" released by "_delete_snapshot" :: held 3.020s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:55 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-44d28b7f-b63f-43dd-9d6a-611fd3768c77" released by "delete_snapshot" :: held 3.051s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:56 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Created reservations ['56279745-38af-4a8b-b4f6-408dd6a863d4', '38fd356a-033c-4eab-98a5-12509e719bc2', '2013521e-e1c4-4458-a572-24270b7b12d5', 'b429be9a-7a27-4e8e-8349-e3fdc920d9fc'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:00:56 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Delete snapshot completed successfully. Jul 08 03:00:56 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-f9b6a7df-adcc-43ae-ad87-8b1dda70f0cc tempest-ProjectMemberTests-1616543176 None] Lock "cinder-25b09e2c-44ea-455a-9e4f-17145d6cf363-delete_snapshot" released by "delete_snapshot" :: held 3.185s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-44d28b7f-b63f-43dd-9d6a-611fd3768c77-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Lock "cinder-44d28b7f-b63f-43dd-9d6a-611fd3768c77-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-44d28b7f-b63f-43dd-9d6a-611fd3768c77" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:00:57 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-44d28b7f-b63f-43dd-9d6a-611fd3768c77" acquired by "delete_volume" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:00:57 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3be67c-018a-4a99-a3bd-3792f17be279]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:00:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:57 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 Jul 08 03:00:57 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:57 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77" returned: 0 in 0.756s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:57 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:58 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77 Jul 08 03:00:58 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:58 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-44d28b7f-b63f-43dd-9d6a-611fd3768c77" returned: 0 in 0.694s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:58 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-44d28b7f-b63f-43dd-9d6a-611fd3768c77" released by "delete_volume" :: held 1.504s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:58 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Created reservations ['279dba8d-9b49-44bb-9f52-b910502ccc55', '43a8cb80-a0c8-49d4-9b01-86314139236b', 'cf856438-1532-4b15-91e1-76cb8fa9e0af', '107a2030-1fed-4dcf-856d-5e4c5e311e2b'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:00:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:00:58 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:00:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:58 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:58 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 03:00:58 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:00:59 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.656s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:00:59 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Deleted volume successfully. Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-0b333be3-1491-47be-b911-7054506fdfeb tempest-ProjectMemberTests-1616543176 None] Lock "cinder-44d28b7f-b63f-43dd-9d6a-611fd3768c77-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (5cd1ac22-e95c-45de-bb2e-b7c392adf007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01df2ff8-8e71-4a21-b8d5-2fe61ae66f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01df2ff8-8e71-4a21-b8d5-2fe61ae66f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1021384710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334b9156-8477-416f-ba90-7d4cb9476e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:01:00Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fcb611-33b7-41e2-80a3-f8663bef4b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fcb611-33b7-41e2-80a3-f8663bef4b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d46364d-b034-41e5-a7e0-a32f3d010db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d46364d-b034-41e5-a7e0-a32f3d010db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '334b9156-8477-416f-ba90-7d4cb9476e11', 'volume_name': 'volume-334b9156-8477-416f-ba90-7d4cb9476e11', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6cd3f2-7ae0-4244-a566-170573db6ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6cd3f2-7ae0-4244-a566-170573db6ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4194f4dd-ea7d-4cfc-9df1-9b47efcbc1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:00:59 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Volume 334b9156-8477-416f-ba90-7d4cb9476e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-334b9156-8477-416f-ba90-7d4cb9476e11', 'volume_size': 1} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1021384710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334b9156-8477-416f-ba90-7d4cb9476e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:01:00Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Creating volume 334b9156-8477-416f-ba90-7d4cb9476e11 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:00:59 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 03:00:59 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:00:59 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11 1073741824 Jul 08 03:00:59 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:00 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11 1073741824" returned: 0 in 0.826s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:00 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:00 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11 Jul 08 03:01:00 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:01 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11" returned: 0 in 0.650s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:01:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:01:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4194f4dd-ea7d-4cfc-9df1-9b47efcbc1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-334b9156-8477-416f-ba90-7d4cb9476e11', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:01:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d952285-4abb-4749-af7b-1347f81b37b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:01:01 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Volume volume-334b9156-8477-416f-ba90-7d4cb9476e11 (334b9156-8477-416f-ba90-7d4cb9476e11): created successfully Jul 08 03:01:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d952285-4abb-4749-af7b-1347f81b37b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:01:01 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (5cd1ac22-e95c-45de-bb2e-b7c392adf007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:01:01 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-d916e356-9c24-4da2-a9d5-321ba66a3d42 tempest-ProjectMemberTests-1616543176 None] Created volume successfully. Jul 08 03:01:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:01:01 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:01:01 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] Creating offline snapshot 04ddd66f-ca15-4fc8-a511-91adf92b3fb0 of volume 334b9156-8477-416f-ba90-7d4cb9476e11 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:01:02 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb5b143-0177-4873-866b-465e634e97a5]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:01:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:02 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11 Jul 08 03:01:02 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:02 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11" returned: 0 in 0.771s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:02 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:02 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0 1G Jul 08 03:01:02 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:03 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0 1G" returned: 0 in 0.785s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:03 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-334b9156-8477-416f-ba90-7d4cb9476e11 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:03 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-334b9156-8477-416f-ba90-7d4cb9476e11 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0 Jul 08 03:01:03 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:04 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-334b9156-8477-416f-ba90-7d4cb9476e11 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0" returned: 0 in 0.701s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:04 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0 is being set with open permissions: ugo+rw Jul 08 03:01:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:04 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0 Jul 08 03:01:04 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:04 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0" returned: 0 in 0.674s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:04 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:04 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.info Jul 08 03:01:04 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:05 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.info" returned: 0 in 0.667s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:05 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.info is being set with open permissions: ugo+rw Jul 08 03:01:05 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:05 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.info Jul 08 03:01:05 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:06 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.info" returned: 0 in 0.662s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:06 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.336s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:01:06 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-033f0cb5-f8b9-4ed6-bbab-d01c2c415156 tempest-ProjectMemberTests-1616543176 None] Create snapshot completed successfully Jul 08 03:01:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-04ddd66f-ca15-4fc8-a511-91adf92b3fb0-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:01:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Lock "cinder-04ddd66f-ca15-4fc8-a511-91adf92b3fb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:01:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-334b9156-8477-416f-ba90-7d4cb9476e11" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:01:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-334b9156-8477-416f-ba90-7d4cb9476e11" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:01:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-04ddd66f-ca15-4fc8-a511-91adf92b3fb0" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:01:07 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-04ddd66f-ca15-4fc8-a511-91adf92b3fb0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:01:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Deleting offline snapshot 04ddd66f-ca15-4fc8-a511-91adf92b3fb0 of volume 334b9156-8477-416f-ba90-7d4cb9476e11 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:01:07 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] snapshot_file for this snap is: volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:01:07 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f934de61-99b0-434f-98b9-ce40d8d1c3ed]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:01:07 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:07 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0 Jul 08 03:01:07 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:08 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0" returned: 0 in 0.746s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:08 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-334b9156-8477-416f-ba90-7d4cb9476e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:01:08 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[5430f7aa-e9ba-4e45-9276-d1ca4db0870a]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:01:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:08 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11 Jul 08 03:01:08 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:08 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11" returned: 0 in 0.768s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:08 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:08 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0 Jul 08 03:01:08 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:09 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0" returned: 0 in 0.753s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:09 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:09 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0 Jul 08 03:01:09 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:10 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:10 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11.04ddd66f-ca15-4fc8-a511-91adf92b3fb0" returned: 0 in 0.662s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-04ddd66f-ca15-4fc8-a511-91adf92b3fb0" released by "_delete_snapshot" :: held 3.020s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:01:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-334b9156-8477-416f-ba90-7d4cb9476e11" released by "delete_snapshot" :: held 3.039s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:01:10 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Created reservations ['72d4e890-2004-4fa9-99d9-fb4a4f659020', '162de3ed-2602-42d5-a1b8-3fe49ce83547', '5a9c3ad3-afd9-4b4f-82f3-ee38dae872e3', '0162dc44-732e-4a48-8bbd-07b04d6fb755'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:01:10 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Delete snapshot completed successfully. Jul 08 03:01:10 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-687decf6-03f9-4f07-ac81-8d5f538d1c6d tempest-ProjectMemberTests-1616543176 None] Lock "cinder-04ddd66f-ca15-4fc8-a511-91adf92b3fb0-delete_snapshot" released by "delete_snapshot" :: held 3.180s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:01:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-334b9156-8477-416f-ba90-7d4cb9476e11-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:01:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-334b9156-8477-416f-ba90-7d4cb9476e11-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:01:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-334b9156-8477-416f-ba90-7d4cb9476e11" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:01:11 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-334b9156-8477-416f-ba90-7d4cb9476e11" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:01:11 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f64ed8-3cea-404f-a564-27665b3e7ce0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:01:11 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:11 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11 Jul 08 03:01:11 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:12 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11" returned: 0 in 0.742s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:12 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11 Jul 08 03:01:12 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:12 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:12 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-334b9156-8477-416f-ba90-7d4cb9476e11" returned: 0 in 0.643s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:12 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-334b9156-8477-416f-ba90-7d4cb9476e11" released by "delete_volume" :: held 1.446s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:01:12 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=67,cinder:UPDATE=83,cinder:DELETE=9,cinder:INSERT=25 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:01:12 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Created reservations ['af8a9f2c-20f3-4daf-a8e4-05a952a19785', 'dd73e565-9611-4893-b4b2-2861e1f9fdf2', '43b7fe2d-77c4-4dc8-a4eb-5c7b72697b7a', 'b343b764-68d0-4ff9-ae87-beb517327ac4'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:01:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:01:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:01:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:01:13 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:01:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:01:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:13 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 03:01:13 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:13 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:13 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.650s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:13 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:01:13 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Deleted volume successfully. Jul 08 03:01:13 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-23f34f98-2823-48d1-b924-e06b421a4e75 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-334b9156-8477-416f-ba90-7d4cb9476e11-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87238) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (bb06e146-ca68-4d3d-956a-494bdebb6ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d8d562-5177-413a-ba51-428f084095d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d8d562-5177-413a-ba51-428f084095d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-914675229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db135a1b-bebc-4de8-b8f3-49a6f23a0a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:01:14Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e06c847-08f6-477f-b2ab-dc3035cda554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e06c847-08f6-477f-b2ab-dc3035cda554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4428ae8d-6412-4569-a56b-201f1f3556ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4428ae8d-6412-4569-a56b-201f1f3556ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db135a1b-bebc-4de8-b8f3-49a6f23a0a55', 'volume_name': 'volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354b8a01-c8c4-4731-9341-5f9edaac0976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354b8a01-c8c4-4731-9341-5f9edaac0976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9750fb5-9c41-4c98-965a-79969f22a4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:01:14 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Volume db135a1b-bebc-4de8-b8f3-49a6f23a0a55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55', 'volume_size': 1} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-914675229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db135a1b-bebc-4de8-b8f3-49a6f23a0a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4733dfc104674a1b8445957e9cdccd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:01:14Z,use_quota=True,user_id='eaced29bf15c45378330432ffe1112bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e67741-409f-4f15-9d0e-1141b1f7ceda),volume_type_id=d3e67741-409f-4f15-9d0e-1141b1f7ceda)}" {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Creating volume db135a1b-bebc-4de8-b8f3-49a6f23a0a55 {{(pid=87238) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Selected osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 as target Quobyte volume. {{(pid=87238) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:01:14 devstack cinder-volume[87238]: INFO cinder.volume.drivers.remotefs [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] casted to osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0 Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 1073741824 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:14 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 1073741824 Jul 08 03:01:14 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:14 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 1073741824" returned: 0 in 0.813s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:14 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:15 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 Jul 08 03:01:15 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:15 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55" returned: 0 in 0.648s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:15 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'} {{(pid=87238) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:01:15 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:01:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9750fb5-9c41-4c98-965a-79969f22a4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55', 'volume_size': 1}' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:01:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277a4ba5-93fb-447f-9d70-4ac4c9bb7029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:01:15 devstack cinder-volume[87238]: INFO cinder.volume.flows.manager.create_volume [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Volume volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 (db135a1b-bebc-4de8-b8f3-49a6f23a0a55): created successfully Jul 08 03:01:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277a4ba5-93fb-447f-9d70-4ac4c9bb7029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87238) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:01:15 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Flow 'volume_create_manager' (bb06e146-ca68-4d3d-956a-494bdebb6ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87238) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:01:15 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-47e77107-0416-46df-9b79-427c7a500f45 tempest-ProjectMemberTests-1616543176 None] Created volume successfully. Jul 08 03:01:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:01:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:01:16 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] Creating offline snapshot 0c511ca4-38ad-4056-9fe2-879ef0a838f8 of volume db135a1b-bebc-4de8-b8f3-49a6f23a0a55 {{(pid=87238) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:01:16 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[44632271-e68c-4874-ae1f-89c9338bdd32]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:01:16 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:16 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 Jul 08 03:01:16 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:17 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55" returned: 0 in 0.759s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8 1G {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:17 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8 1G Jul 08 03:01:17 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:17 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8 1G" returned: 0 in 0.806s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:17 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:17 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8 Jul 08 03:01:17 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:18 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 -F qcow2 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8" returned: 0 in 0.680s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:18 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8 is being set with open permissions: ugo+rw Jul 08 03:01:18 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:18 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8 Jul 08 03:01:18 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:19 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8" returned: 0 in 0.653s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:19 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=96,cinder:SELECT=71,cinder:INSERT=26,cinder:DELETE=6 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:01:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:19 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.info Jul 08 03:01:19 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:19 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.info" returned: 0 in 0.650s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:19 devstack cinder-volume[87238]: WARNING cinder.volume.drivers.remotefs [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.info is being set with open permissions: ugo+rw Jul 08 03:01:19 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.info {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:19 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.info Jul 08 03:01:19 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:20 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.info" returned: 0 in 0.647s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:20 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.276s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:01:20 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-99e94bca-7bff-4631-b174-eb3c7314d12b tempest-ProjectMemberTests-1616543176 None] Create snapshot completed successfully Jul 08 03:01:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-0c511ca4-38ad-4056-9fe2-879ef0a838f8-delete_snapshot" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:01:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Lock "cinder-0c511ca4-38ad-4056-9fe2-879ef0a838f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:01:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-db135a1b-bebc-4de8-b8f3-49a6f23a0a55" by "delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:01:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-db135a1b-bebc-4de8-b8f3-49a6f23a0a55" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:01:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-0c511ca4-38ad-4056-9fe2-879ef0a838f8" by "_delete_snapshot" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:01:21 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-0c511ca4-38ad-4056-9fe2-879ef0a838f8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:01:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Deleting offline snapshot 0c511ca4-38ad-4056-9fe2-879ef0a838f8 of volume db135a1b-bebc-4de8-b8f3-49a6f23a0a55 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:01:21 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] snapshot_file for this snap is: volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8 {{(pid=87238) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:01:21 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e64e01-ab12-4733-b712-cef18b74b4bd]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:01:21 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:21 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8 Jul 08 03:01:21 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:22 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8" returned: 0 in 0.774s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:22 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.remotefs [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87238) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:01:22 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbc8a58-c191-41a1-aaec-69f5a2fa85d0]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:01:22 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:22 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 Jul 08 03:01:22 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:23 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55" returned: 0 in 0.757s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:23 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8 Jul 08 03:01:23 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:23 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8" returned: 0 in 0.735s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:23 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:23 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8 Jul 08 03:01:23 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:24 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:24 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55.0c511ca4-38ad-4056-9fe2-879ef0a838f8" returned: 0 in 0.667s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-0c511ca4-38ad-4056-9fe2-879ef0a838f8" released by "_delete_snapshot" :: held 3.024s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:01:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-db135a1b-bebc-4de8-b8f3-49a6f23a0a55" released by "delete_snapshot" :: held 3.045s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:01:24 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Created reservations ['99ad30b7-c384-4c35-b051-0ed8862ac02e', 'ceb3ec85-68a6-4b7d-b276-4a70842ce8d2', '11751dae-1f88-4dc2-89c4-edfafae5c4d2', '8b277089-de08-4f79-ba3e-4de129e017b6'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:01:24 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Delete snapshot completed successfully. Jul 08 03:01:24 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-baa7055e-83ab-4903-ae7e-07425bdb5bdd tempest-ProjectMemberTests-1616543176 None] Lock "cinder-0c511ca4-38ad-4056-9fe2-879ef0a838f8-delete_snapshot" released by "delete_snapshot" :: held 3.176s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:01:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-db135a1b-bebc-4de8-b8f3-49a6f23a0a55-delete_volume" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:01:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-db135a1b-bebc-4de8-b8f3-49a6f23a0a55-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:01:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "cinder-quobyte-db135a1b-bebc-4de8-b8f3-49a6f23a0a55" by "delete_volume" {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:01:25 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-db135a1b-bebc-4de8-b8f3-49a6f23a0a55" acquired by "delete_volume" :: waited 0.014s {{(pid=87238) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:01:25 devstack cinder-volume[87238]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6959407-7c73-4e05-ad2a-b76530e71f41]: (4, 'qcow2') {{(pid=88198) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:01:25 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:25 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 Jul 08 03:01:25 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:26 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55" returned: 0 in 0.767s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:26 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:26 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55 Jul 08 03:01:26 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:27 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b/volume-db135a1b-bebc-4de8-b8f3-49a6f23a0a55" returned: 0 in 0.630s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:27 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-quobyte-db135a1b-bebc-4de8-b8f3-49a6f23a0a55" released by "delete_volume" :: held 1.453s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:01:27 devstack cinder-volume[87238]: DEBUG cinder.quota [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Created reservations ['757e48a4-cdc8-43cd-a09b-cb1ce7ffcab6', '824c7374-ef22-4503-8170-6484c5457c0a', 'e502575c-2c9a-4c3d-87c1-87e15f4c3d3e', 'affab2eb-06b9-45b3-ac99-19a5ff23ee82'] {{(pid=87238) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:01:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:01:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:01:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:01:27 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:01:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:01:27 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:27 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 03:01:27 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:28 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:28 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.659s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:28 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:01:28 devstack cinder-volume[87238]: INFO cinder.volume.manager [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Deleted volume successfully. Jul 08 03:01:28 devstack cinder-volume[87238]: DEBUG cinder.coordination [None req-bec597aa-12ec-4acd-8747-a335ce1f25d4 tempest-ProjectMemberTests-1616543176 None] Lock "cinder-db135a1b-bebc-4de8-b8f3-49a6f23a0a55-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=87238) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:01:37 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:UPDATE=25,cinder:SELECT=19,cinder:INSERT=6 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:01:38 devstack cinder-volume[87238]: DEBUG dbcounter [-] [87238] Writing DB stats cinder:SELECT=9,cinder:DELETE=2,cinder:INSERT=4,cinder:UPDATE=15 {{(pid=87238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:01:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:01:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:01:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:01:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0': None} {{(pid=87238) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:01:47 devstack cinder-volume[87238]: DEBUG cinder.volume.drivers.quobyte [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92ab4c62-a6e4-46ab-8dd2-8a85e7a3e5e0'] {{(pid=87238) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:01:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.lockutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87238) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:01:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:01:47 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b Jul 08 03:01:47 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:01:47 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jul 08 03:01:47 devstack cinder-volume[87238]: DEBUG oslo_concurrency.processutils [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a981b648022324a581245d6cbe0b15b" returned: 0 in 0.651s {{(pid=87238) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:01:47 devstack cinder-volume[87238]: DEBUG cinder.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Notifying Schedulers of capabilities ... {{(pid=87238) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:01:47 devstack cinder-volume[87238]: DEBUG oslo_service.periodic_task [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87238) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:01:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread count: 29 {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:01:47 devstack cinder-volume[87238]: DEBUG cinder.volume.manager [None req-ff7aa253-8df0-4c67-a141-c859b14a22e5 None None] thread info: [<_MainThread(MainThread, started 133290350276736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87238) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}